Design a real-time mobile analytics pipeline
Source: dagster.ioadvanced
Tests decoupling high-volume ingestion from low-latency querying. Strong designs use an event broker, a stream processor for windowed aggregates, and an OLAP database for sub-second dashboards.
This tests whether you can decouple high-volume ingestion from low-latency querying without creating a single bottleneck. A strong answer outlines four layers: a mobile SDK with batching and backoff; an event broker like Kafka or Kinesis for ingestion; a stream processor like Flink or Spark Streaming for windowed aggregations; and an OLAP sink like ClickHouse or Druid for sub-second dashboard queries.
Read the original → dagster.io
- #analytics
- #stream-processing
- #system-design
- #real-time
- #data-pipelines
Get five bites like this every day.
Tezvyn delivers a daily feed of 60-second tech bites with quizzes to lock in what you learn.