Explain Simpson's Paradox with a user engagement example

Tests if you see beyond aggregate data. Define the paradox, give a numerical example where a feature fails overall but wins in segments (e.g., new vs. returning users), and name the confounding variable. A vague definition without numbers is a red flag.
This tests your ability to recognize when aggregated data is misleading and to identify confounding variables. A great answer defines the paradox (a trend reverses when groups are combined), then gives a clear numerical example where a feature fails in aggregate but succeeds for both new and returning users. Explain that unequal segment sizes caused the distortion. The most common red flag is giving a definition without a plausible, concrete example, which fails to demonstrate practical data literacy.
Read the original → statsig.com
- #analytics
- #metrics
- #a/b testing
- #statistics
Get five bites like this every day.
Tezvyn delivers a daily feed of 60-second tech bites with quizzes to lock in what you learn.