Analytics
494 bites tagged Analytics — interview questions with model answers, and 60-second explainers.
How would you debug a sudden drop in a key metric?
Tests your systematic debugging of complex data systems. First, validate the drop against a source of truth and segment the data. Then, hypothesize causes like misattribution or data loss.
How do you track page views in a Single Page Application?
This tests your grasp of SPA routing mechanics. A great answer covers both programmatic navigation (using router hooks) and browser history events (`popstate`), explaining why both are necessary.
How would you measure the ROI of a data analytics platform?
This tests your ability to connect platform engineering to business value. A great answer quantifies ROI via cost savings, revenue generation, and risk reduction, then details the systems (e.g., cost tagging, metadata tracking) needed.
How would you design an analytics strategy for a marketplace?
Tests your ability to balance conflicting needs in a complex system. A great answer covers core health (liquidity, match rate), side-specific KPIs (buyer satisfaction, seller utilization), and unit economics (take rate).
Explain the North Star Metric and propose one for a product
Tests your ability to link product strategy to a single metric reflecting customer value and business growth. Define the NSM, propose one for a product like Spotify, and justify it. A red flag is picking a vanity metric like DAU or a pure business metric.
How would you diagnose a flat feature adoption KPI?
This tests your ability to create a diagnostic plan from a single lagging metric. A great answer outlines a funnel (Awareness > Activation > Usage), segments users, and combines quantitative data with qualitative feedback.
Pitfalls of 'Conversion Rate' as a North Star Metric
This tests your ability to see beyond a single metric and understand its second-order effects. A strong answer identifies pitfalls like lower AOV, then proposes counter-metrics (AOV, return rate) and guardrail metrics (page load time).
Translate 'increase engagement' into a technical measurement plan
This tests your ability to translate vague business goals into concrete metrics. First, clarify the goal with the PM. Then, propose specific, measurable proxy metrics (e.g., DAU/MAU, session length). Finally, outline the instrumentation plan.
RFM Analysis: Find Your Best Customers
RFM analysis segments customers by scoring their Recency, Frequency, and Monetary value. This helps identify your best customers (high RFM), those at risk (low R/F), and new high-spenders.
Bullet Graphs: Packing Context into a Single Bar
A bullet graph packs rich context into one bar, showing a metric against its target and qualitative ranges. Use it on dashboards for single KPIs like sales-to-quota or latency vs. SLA. The footgun is clutter, which defeats its at-a-glance purpose.
Pre-attentive Attributes: How Your Brain Sees Data First
Pre-attentive attributes are visual properties your brain processes instantly, before conscious thought. They're used in data visualization to make key information 'pop,' like using color to highlight an outlier.
GSM: Connect Your Goals to Real Metrics
The GSM framework turns fuzzy goals into concrete numbers by linking what you want (Goal), to observable behaviors (Signal), to a specific measurement (Metric). It's used to define KPIs for new features. The footgun is choosing easy-to-measure vanity metrics.
Randomized Controlled Trials: The Gold Standard for 'Did It Work?'
An RCT is a science fair experiment for business decisions, isolating one change to see its true effect. It's used in A/B tests to prove a new feature worked. The biggest footgun is peeking at results early, which can lead to false conclusions.
ETL: The Assembly Line for Your Data
ETL (Extract, Transform, Load) is an assembly line for data, moving it from various sources into a single destination for analysis. It's used to populate data warehouses by combining data from databases, logs, and APIs into a unified view.
Clickstream Analysis: Following the User's Footsteps
Clickstream analysis is like watching a replay of a user's journey through your site, click by click. It's used to optimize conversion funnels and find friction points. The footgun is focusing on the *what* (the path) without asking *why* a user took it.
Heatmaps: Visualizing User Attention
Think of a heatmap as a weather map for your app, showing 'hot' spots of user clicks and 'cold' spots they ignore. It reveals if users are clicking key buttons or getting distracted. The footgun: a hot spot can mean rage-clicks, not just engagement.
Figma Library Analytics: Measure Your Design System's Impact
Treat your design system like a product by measuring its adoption. Figma's Library Analytics shows which components and styles are actually used, guiding decisions on what to build, improve, or deprecate.
App Store Connect Analytics
App Analytics in App Store Connect is Apple's built in, privacy preserving dashboard showing how users find, install, and use an app, covering impressions, product page views, conversion rate, downloads, and retention, with no SDK required.
Instrumentation Plan: Your Analytics Blueprint
An instrumentation plan is the blueprint for what user actions to track. It's like deciding where to put security cameras *before* building, not after a break-in. It's essential for new features and for cleaning up messy analytics.
Metrics Layer: The Dictionary for Your Data
A metrics layer is the central dictionary for your company's numbers, defining what "Revenue" or "Active User" means once for everyone. It ensures teams and AI agents get consistent answers from a single source of truth, preventing conflicting reports.
Growth Accounting: What's Really Driving Your Growth?
Growth accounting splits your growth into two parts: adding more resources (like ad spend) and getting better with what you have. Use it to see if growth came from a bigger budget or a better product.
DAU/MAU Ratio: Measuring Product Stickiness
The DAU/MAU ratio measures product “stickiness” by showing what percentage of your monthly users return daily. A high ratio suggests a strong daily habit, common for social or communication apps. The footgun is judging all products by the same benchmark.
Customer Retention: Are Users Sticking Around?
Customer retention measures if users return to your product. It's often more valuable to keep an existing customer than acquire a new one. This is critical for any business relying on repeat engagement, from SaaS to e-commerce.
Attribution Modeling: Who Gets Credit for a Conversion?
Attribution modeling decides how to credit different marketing channels for a conversion. It's like splitting a sales commission: does the first call, the final meeting, or everyone involved get credit? The footgun is using a simplistic model like last-touch.
Get Analytics bites daily.
Five a day, five minutes, offline. With quizzes so it sticks.
Open testing — you’ll join as an early tester.