Last week, Jason Cohen wrote a very comprehensive blog on software-as-a-service churn: Deep Dive – Cancellation Rate in SaaS Business Models. I required everybody at Totango to read this blog and recommend that you do the same. Jason looks at many different definitions for the SaaS Cancellation Rate metric.
Eventually, Jason recommends performing cohort analysis when looking at cancellation rates. He suggests to divide customers in segments based on their “time to cancel” (i.e. canceled after 30 days vs. canceled after more than 30 days) and, for all intents and purposes, he recommends focusing in the long-term users who have greater business revenue potential and cancellation reasons which can be addressed and resolved more easily.
This is indeed an interesting way to look at it, and very analogous to the importance of the “time to convert” metric when it comes to inbound marketing and trial conversion. However, I argue that this is not the only, and maybe not always the best, way to do cohort analysis on SaaS churn.
Let’s take for example an email service application. If 2 users have signed up at the same time:
- One of them is using the service more frequently, creating many accounts, visits almost all application features and cancels after 10 days
- The other accesses the service 3 times a week but just checking very limited features and cancels after 31 days
Who should be given more weight?
If I’d measure by Jason, I would focus my efforts on the second user, but if I weigh my analysis with user behavior altogether, then my most valuable customer to understand is the first one.
So this leaves us with three promising ways to segment customers for cohort analysis:
- Traditional way: create cohorts based on the week or month in which they signed up for the service. This will allow you to analyze the effect of changes you made to your product or service over time.
- Jason’s way: to create cohorts based on the “time to cancel” (or the “time to convert” for that matter). This will allow you to focus on long-time users of your product and sift out those who signed up in error.
- The customer engagement way: to create cohorts based on the “engagement level” with the product or service. This will allow you to focus on frequent users of your products, independent on how long it took them to cancel, but still sift out those who signed up in error (and never started to use the product).
Of course, in all cases, measurement is just the first phase of the process and the complementary phase must be to prioritize the changes needed in the service which would ultimately lead to increase customer satisfaction and customer engagement.
What about you? What is your definition for cohort analysis?
[CTA-6-Steps-to-Boost-Sales]
Engagement Technique: Are you a Mad Man or a Math Man? | Best Customer Success Blog | Trends & Articles for Enterprise Growth says:
[…] indeed, we can see decisions are being made more and more based on metrics and cohort analysis rather than on our guts feeling. It’s not enough to feel it inside – you should base […]
James says:
Im quite new to this and wanted to see if there are any programs that work like google analytics, enter a code and the site calculates the number of sign-ups and churn. As to do it manually seems impossible.
Thanks
Quora says:
What is the average web site conversion rate among B2B SaaS services for web site visitor to 30 days free trial CRM? (all traffic come from Google Adwords)…
There is one really big assumption being made here which is that you do not ask for a credit card at the start of the trial. SEOmoz for example, which does ask for a credit card up front, converts approximately 56% free trials into paid memberships, Of…
Quora says:
What is a reasonable churn rate for a subscription business?…
Before you can answer this question, you first need to answer the question what is your definition of churn? Many people talk about churn in terms of number of customers, whereas I think it’s even more important to think about churn in terms of revenu…
Quora says:
What are some typical customer churn rate assumptions that a subscription based SaaS startup (e.g. CRM) could use in its business plan?…
Before you can answer this question, you first need to answer the question what is your definition of churn? Many people talk about churn in terms of number of customers, whereas I think it’s even more important to think about churn in terms of revenu…
Engagement Technique: Are you a Mad Man or a Math Man? says:
[…] indeed, we can see decisions are being made more and more based on metrics and cohort analysis rather than on our guts feeling. It’s not enough to feel it inside – you should base […]
Best of 2011: Top Videos and Blogs on Customer Engagement says:
[…] 3 Ways to do Cohort Analysis on SaaS Churn […]
Tip on How to Reduce Churn (Even in Low-Touch Models) says:
[…] the right metrics and cohort analysis, it’s easy to decide who are the more engaged customers that are ready for sale and […]
Using Customer Analytics to Increase Revenues of SaaS Business says:
[…] 3 Ways to do Cohort Analysis on SaaS Churn Joel York: Why to Measure Customer Engagement in SaaS? […]
3 Outright Strategies to Improve SaaS Customer Success says:
[…] of sign-ups may never activate the service. I discussed this phenomena in my blog on “3 ways to do cohort analysis on SaaS churn“. In the case of Outright, they have explicitly modeled the different stages in what you […]
VP Customer Success at Alcove9: on boarding SaaS customers says:
[…] We are interested in adoption rates: who is downloading our application, who is installing it and then adoption metrics of different modules, such as which features they are using and finally retention rates (churn). […]
Joel York: Why to Measure Customer Engagement in SaaS? says:
[…] Of course, I also believe that not all trial customers are created equal. As we discussed in a previous post: a prospect with many users and many hours of trial usage is a hotter prospect than a trial user […]
Jason Cohen says:
Great point. I agree “engagement level” is better. It’s better because it’s describing something more important, and because it’s more analog than just “cancel/no-cancel.”
To be clear, though, I don’t recommend ignoring short-term cancellation. In fact, the short-term rate is always much larger, *and* more likely that your behavior/features/product can change it, therefore that, and not the long-term, is often where you should focus your attention.
If the long-term rate is high, that’s a fundamental problem with the business. If it’s low, then short-term is more important.
But your way is more valuable. Probably it’s best to think of cancellation as “I failed, and now it’s too late,” i.e. first warning that something is amiss. Whereas engagement is more interesting, if more subtle.
I also agree: The person who really tried and still failed is more of a “business failure” than the person who never even really tried. Because the first REALLY should not have cancelled if you were doing a good job. You ought to be able to save them.
Thanks for the insight.
Guy Nirpaz says:
Jason,
Thanks for you kind comment.