Solved

Inconsistent W1 Retention in 4W vs 8W

  • 19 July 2021
  • 2 replies
  • 240 views

New to the community, I hope someone can help me with a questions around retention.

When measuring weekly retention, why is my W1 retention in 4W view vs 8W view so different? ~59 vs 39%. I am pretty confident the inputs are correct. Am I missing something here?

Thanks in advance!

 

 

icon

Best answer by Nicol Hawkins 20 July 2021, 21:58

View original

2 replies

Userlevel 5
Badge +3

New to the community, I hope someone can help me with a questions around retention.

When measuring weekly retention, why is my W1 retention in 4W view vs 8W view so different? ~59 vs 39%. I am pretty confident the inputs are correct. Am I missing something here?

Thanks in advance!


These kinds of quirks in retention figures are typically down to different cohorts being different sizes and showing different behaviour. You can get more details on your data by switching from Retention view to Change over time, using the dropdown options below Retention View / Usage Interval View switch.

 

For more details and some examples, check this recent thread:

 

 

Userlevel 3
Badge +2

To add to MikkoKarvonen’s point, it is important to recognize how your chart’s interval affects the percentages displayed. The reason why the percentages for the ‘Last 8 weeks’ chart are higher is due to the fact that more time has elapsed which gives more users a chance to be week 1 retained. 

Let’s look at an example from our demo to illustrate this point by examining the breakdown table: Example

4PsKbAMjDrsREF5humfPMNDmdJGVcLAj56atErGlNCRW9bg5nlqShWhUt8GBl5qKTYFP9LhLDN-wc3AI7j6UyucJdSoiYtNpH5P3swlWV-GxIyvVHrI4y81GSBr8MkSclry2XxAK

If you expand the breakdown table below your chart, you will see that there are ​several weeks worth of data. The figures in the top row represent the deduplicated weighted averages for weekly retention which is reflected on the chart, while the numbers in the columns below it were used to calculate that average. Essentially, each data point for week N will be the weighted average of the percentage of users retained that week. 

In this chart, week 0 represents the week of June 21st, June 28th, July 5th, July 12th, and July 19th. Consider the cohort of 62,786 users who entered your retention analysis in the week of June 28th. Their week 0 occurred sometime in the week of June 28th, their week 1 occurred sometime in the month of July 5th, and so on. 

When you change your chart’s interval from 4 weeks -> 8 weeks, this allows for more week 1 data to be collected and calculated into the weighted average for week 1 retention.

Reply