Design a Real-Time Analytics Pipeline for Mobile Events
Source: dagster.ioadvanced
Tests your grasp of low-latency, high-throughput design. A strong answer outlines ingestion (Kafka), stream processing (Flink), and a real-time OLAP database (Druid/ClickHouse). A red flag is proposing a slow, batch-only architecture.
This tests your ability to design for low latency and high throughput, balancing cost and complexity. A strong answer outlines four stages: ingestion (Kafka/Kinesis), stream processing (Flink/Spark), storage in a real-time OLAP database (Druid/ClickHouse), and the dashboard's query layer. A major red flag is suggesting a batch-oriented solution that misses the 'seconds' latency requirement.
Read the original → dagster.io
- #system design
- #data engineering
- #analytics
- #streaming
Get five bites like this every day.
Tezvyn delivers a daily feed of 60-second tech bites with quizzes to lock in what you learn.