Correlate API Slowness with User Engagement
This tests your ability to design a controlled experiment and join disparate data. A good answer outlines an A/B test with an artificial delay, logging with shared IDs, and statistical analysis. A red flag is proposing a purely observational study.
This question tests your ability to design a robust, controlled experiment and architect the data pipeline to prove causation. A great answer details an A/B test that artificially delays responses for a test group, explains the critical need for a shared ID to join performance logs with analytics events, and discusses the final statistical analysis. A common wrong answer is to propose a simple observational study, which fails to control for confounding variables and cannot prove that slowness *causes* the drop in engagement.
Read the original → optimizely.com
- #analytics
- #metrics
- #a/b testing
- #system design
Get five bites like this every day.
Tezvyn delivers a daily feed of 60-second tech bites with quizzes to lock in what you learn.