07.5.3 · Skill in Activation diagnosis
Activation experiments
Testing changes to the first experience to improve activation.
Activation experiments test changes such as shorter signup, different first tasks or new guidance. They need an activation metric that predicts retention, not only completion of the onboarding flow. New-user traffic makes them easier to run than most experiments.
Resources
1- articleStart hereHow not to run an A/B test ↗Evan Miller · 2010 · 8 min
The classic explanation of why peeking at results and stopping early produces false wins, and what to do instead.
Tools
1- ToolOpen sourceGrowthBook
Open-source feature flags and A/B testing that analyzes results from your own data warehouse.