Product sense
69 bites tagged Product sense: interview questions with model answers, and 60-second explainers.
Test yourself: Top 30 Product sense interview questions →Multiple choice, with the correct answer and why it is correct on every question. Free, no sign-in.Outline a research plan to diagnose low adoption despite positive usability tests
Tests distinguishing usability from adoption drivers. Strong answers hypothesize discoverability, motivation, and timing gaps; use behavioral triangulation, contextual inquiry, and surveys. Red flag: blaming users or redesigning before diagnosing the funnel.
How do you proactively collaborate with a researcher before a complex study?
This tests cross-functional partnership. A strong answer hits four things: share system boundaries, align on research goals via mutual education, scope the study for tangible user impact, and reframe methods into accessible language.
Describe the technical setup and trade-offs of large-scale unmoderated checkout usability testing
Clickstream logging, success rates, surveys; contrast speed with moderator engagement.
Describe lightweight user validation without a dedicated researcher
This tests if you value direct user feedback over expert-only evaluation without researchers. A strong answer covers recruiting fresh users and observing real use for intuitiveness.
What lightweight generative research reveals why users drop off a funnel?
Tests bridging analytics to qualitative insight fast. Outline: run 5-8 micro-interviews at the exact drop-off step; probe confidence and expectations; map findings to technical fixes.
Translate qualitative insights into user stories and requirements
Clusters themes by frequency/severity, reframes pain points as user stories with clear AC, maps to technical spikes, prioritizes by impact.
What is the goal of contextual inquiry and what do engineers gain?
Tests grounding engineering in observed user behavior. Goal: watch users in their environment to uncover tacit work practices, workarounds, and mental models. Engineers learn system constraints, integrations, and reliability gaps.
What trade-offs matter between moderated usability tests and surveys?
Whether you align research method to product risk and insight type. Great answers contrast surveys for scalable opinions against moderated tests for behavioral observation, weighing fidelity and speed.
Explain qualitative vs quantitative user data with engineering examples
Contrast the two modes and give one example per type.
What counter metrics track health of weekly active users?
Tests whether you can spot growth-at-all-costs blind spots. A strong answer pairs WAU with 7-day retention, sessions per user, and error rate, mapping each to churn, shallow engagement, or bugginess.
A/B test: 0.1% lift. Statistical vs practical significance?
Statistical significance says the 0.1% is real; practical significance asks if revenue exceeds engineering cost. Frame with CIs and ROI.
How do you frame high-value customer identification as classification versus regression?
Tests mapping a business goal to a defensible target. Outline: define value and action, then contrast regression predicting spend versus classification predicting tiers. Red flag: picking models before fixing the label or the campaign action.
What user segments do you check first after a 10% DAU drop?
Validate by time, platform, and geography; then slice by new vs returning, channel, and feature usage to isolate the bleeding cohort.
Define and calculate Weekly Active Users (WAU) for Slack
Tests translating a business metric to a technical spec. Define 'active' by key actions (sending messages, not just opening), then COUNT(DISTINCT user_id) on an events table, filtering out bots and background syncs. A red flag is a generic definition.
What is a p-value, and what does 0.03 practically mean?
This tests your ability to translate stats into business decisions. A great answer defines p-value, compares 0.03 to the standard 0.05 threshold to reject the null hypothesis, and recommends shipping.
Visualize Correlation Between Load Time and Session Duration
Tests your ability to choose the right chart for correlation and layer in additional variables. A great answer starts with a scatter plot (load time vs. session duration), then uses color to represent the network type.
Set up a cohort analysis for a new onboarding flow
This tests your ability to design a clean experiment to measure product impact. A great answer defines control/treatment cohorts by acquisition date (before/after Jan 1st), picks a specific metric like W1 retention, and compares them.
How to visualize a complex, multi-stage customer funnel?
Tests your ability to choose the right visualization for non-linear user flows. Propose a Sankey or Alluvial diagram to show flow volume, drop-off, and re-entry. A red flag is suggesting multiple simple charts that fail to show the paths between stages.
How would you design a 'button_click' analytics event payload?
This tests your ability to design for future analysis. A great answer specifies core identifiers (user ID, timestamp), contextual properties (page, component), and a flat JSON structure. A red flag is forgetting the user ID or providing an unstructured list.
Apply the AARRR framework to B2B SaaS vs. B2C mobile games
Tests translating the AARRR framework into concrete analytics for different business models. Define AARRR, then contrast B2B SaaS (account-level activation) with B2C games (user-level engagement). Red flag: using identical metric definitions for both contexts.
What is the difference between a metric and a KPI?
This tests your ability to connect technical measures to business outcomes. Define metrics as operational data and KPIs as the subset tied to critical goals.
Design a self-service analytics platform for non-technical users
Tests your ability to abstract SQL. A great answer outlines a semantic layer for virtual datasets, a no-code drag-and-drop UI, and a backend that translates UI state into SQL queries. A red flag is describing only a SQL editor, ignoring non-technical users.
Primary vs. Guardrail Metrics in Experiments
Tests your grasp of risk management in A/B testing. A great answer defines a primary metric as the goal and a guardrail as a 'do no harm' check. A feature ships only if the primary improves without hurting guardrails.
How would you A/B test a 'Buy Now' button color change?
Tests your grasp of the A/B testing lifecycle. A strong answer defines a clear hypothesis (e.g., 'a green button will increase clicks'), selects a primary metric (CTR), and considers guardrail metrics. A red flag is skipping the hypothesis and metrics.
Get Product sense bites daily.
Five a day, five minutes, offline. With quizzes so it sticks.
The iPhone app is on the way
We are building it. Until it lands, nothing here is held back from you: every interview card, your saved cards, streaks and the job board all work in Safari, plus hundreds of free practice quizzes of thirty questions each. Sign in and it all carries over to the app the day it arrives.
Want it as an icon? Tap Share at the bottom of Safari, then Add to Home Screen. It opens full screen and the cards you have read stay available offline.