Explain Simpson's Paradox and construct a user engagement scenario
Tests whether you spot trends reversing when population mixes differ. Good answers define the paradox, give a numerical example with per-segment wins but aggregate loss, and warn against segment-only decisions.
Tests whether you recognize that aggregate metrics can hide or flip segment-level truths when confounding variables shift across groups. A strong answer defines Simpson's Paradox, constructs a concrete new-vs-returning scenario with real numbers where the feature improves both segments yet drags the total down, explains the mechanism, usually a larger share of low-baseline users in treatment, and warns against shipping on segment splits without checking overall consistency.
Read the original → statsig.com
- #simpsons paradox
- #ab testing
- #metrics
- #experimentation
- #statistics
Get five bites like this every day.
Tezvyn delivers a daily feed of 60-second tech bites with quizzes to lock in what you learn.