SaaS · Growth
Onboarding checklist A/B test
Reading an onboarding experiment's lift on activation on your warehouse, with retention as a guardrail.
Onboarding checklist vs. current onboarding
+13.5%
Significant winActivation within 14 days
095% interval +7.9% to +19.1%
Checklist
Current onboarding
control
Who it's for
Growth and product teams who run onboarding experiments in a feature-flag tool and need results they can trust.
What it solves
Analyze the onboarding test on the exposure data in your warehouse, with the same activation definition as your dashboards, and know when the result is safe to ship.
Questions it answers
Did the new checklist lift activation?
Activation rose from 34.0% to 38.6%, a 13.5% lift (95% interval +7.9% to +19.1%).
Did retention or support tickets move against us?
Week-2 retention and support tickets per account stayed within their guardrails.
- Is the lift significant, and how large is the interval?
- Which segments responded best?
The impact
- Ship onboarding changes on evidence, not on a dashboard glance
- One activation definition for experiments and reporting
- Catch tests that win on one metric and lose on another
The data it needs
- Exposure events from your experimentation or feature-flag tool
- Onboarding and activation events
- Account and plan attributes
Read in place in your warehouse. Nothing is copied out.
Onboarding checklist A/B test: frequently asked questions
Run this on your own data.
Start free on your warehouse, or book a demo and we'll show it on your data.