How do you determine sample size and duration for an A/B test?
This tests your grasp of statistical power and business trade-offs. A good answer defines the four inputs (baseline, MDE, significance, power) to calculate sample size, then uses traffic to find duration.
This question tests your grasp of the statistical foundations of A/B testing—specifically power, significance, and the inputs for a valid experiment. It also probes your ability to balance rigor with business velocity. A strong answer defines the four inputs for a power calculation (baseline, MDE, alpha, beta), explains how they determine sample size, and how traffic then dictates duration. A major red flag is suggesting a fixed duration like "two weeks" without first calculating the necessary sample size.
Read the original → cxl.com
- #a/b testing
- #metrics
- #statistics
- #product analytics
Get five bites like this every day.
Tezvyn delivers a daily feed of 60-second tech bites with quizzes to lock in what you learn.