Skip to content
tezvyn:

Top 30 Intermediate Growth & Experimentation Interview Questions and Answers

30 intermediate multiple-choice Growth & Experimentation interview questions, past the definitions: how the pieces fit together, what breaks in practice, and the trade-off behind a choice. They come from 30 bites in the Growth & Experimentation library, the middle slice of the 130 Growth & Experimentation interview questions in the library. Answer them here or read straight down. Every question carries the correct option, why it is correct, and a link to the bite it came from.

A/B testing, growth loops, conversion, retention

30 questions. Pick an answer, or open “Show the answer” to read it.

Answers are graded in your browser. Nothing is saved, and no XP or streak is earned here. The app keeps score.

  1. Question 1 of 30

    Which approach correctly implements the Effort component in an automated RICE scoring pipeline?

    Show the answer

    Answer: d · Pull estimates from project management APIs, convert to person-months using historical velocity, and calibrate for optimism

    Effort is correctly built by pulling PM estimates, converting them to person-months via historical velocity, and calibrating for optimism because human estimates are systematically optimistic. Option B represents the common red flag of attempting to derive Effort from code complexity or logs, which cannot replace human estimation.

    Read the full bite: Describe RICE scoring and architect data pipelines for Reach and Effort

  2. Question 2 of 30

    Which approach best minimizes interaction bias across concurrent experiments while preserving platform velocity?

    Show the answer

    Answer: d · Use orthogonal layers with reservation amounts, restricting mutual exclusion to tightly coupled features

    Orthogonal layers isolate independent experiments via separate randomization units and reservation amounts prevent layer starvation, while mutual exclusion is reserved for high-risk features because global use destroys velocity. The most tempting distractor, adding post-hoc interaction terms, fails because clean causal inference requires designed allocation—regression cannot fix unstructured overlaps after the fact.

    Read the full bite: How do you design allocation logic to minimize concurrent A/B test interactions?

  3. Question 3 of 30

    An analyst needs to compute a signup funnel and segment users by UTM source without joining lookup tables for common dimensions. Which schema approach best enables this?

    Show the answer

    Answer: d · Use a wide atomic events table with dedicated columns for UTM source, user_id, and session_id, plus extensible context tables joined only for custom attributes

    A wide atomic table places common segmentation dimensions like UTM source directly on the event row, letting analysts filter and group without joins, whereas a normalized OLTP schema forces complex joins and state reconstruction that slow down funnel queries.

    Read the full bite: How would you structure an event schema for funnel and cohort analysis?

  4. Question 4 of 30

    When calculating weekly cohort retention, why is computing week_offset from each user's signup_date preferable to grouping activity by calendar week?

    Show the answer

    Answer: d · It ensures retention measures each cohort's return behavior relative to its own signup origin

    Computing week_offset anchors every activity to the user's specific signup cohort, which is the defining requirement of cohort retention; option C describes grouping all users into calendar activity weeks, which is the classic global active users trap that fails to measure cohort-specific return behavior.

    Read the full bite: Describe the SQL and data model for weekly cohort retention

  5. Question 5 of 30

    Which strategy most effectively enforces analytics schema consistency at scale without creating a process bottleneck?

    Show the answer

    Answer: d · Use a version-controlled schema registry with generated SDKs, CI build failures, and edge validation, plus lightweight self-service governance

    Option D is correct because it layers automated prevention, detection, and self-service governance to treat data quality as a systems problem rather than relying on human vigilance. Option A is a tempting distractor because documentation and manual review sound like governance, but the card identifies them as red flags that rot under delivery pressure and create scaling bottlenecks.

    Read the full bite: Propose a strategy to enforce a consistent analytics event schema

  6. Question 6 of 30

    Which telemetry design best separates user abandonment from backend payment failures?

    Show the answer

    Answer: b · Send periodic visibility heartbeat pings with checkout_id and correlate with server-side gateway response events

    Heartbeat pings let you distinguish tab closure from temporary backgrounding, and correlating with server gateway responses isolates hard declines from user intent. A single checkout_failed event collapses distinct failure modes into one unactionable metric, while relying on page unload events alone misses a large share of mobile exits.

    Read the full bite: How do you instrument client and server to debug payment drop-offs?

  7. Question 7 of 30

    After discovering a divergence between client order_completed events and backend orders, what is the most appropriate immediate first step?

    Show the answer

    Answer: d · Run a time-bound join on user ID and order ID to compute daily deltas segmented by platform

    The correct approach begins with phase-one quantification: joining both systems to measure the gap direction and scale before applying fixes or deep tracing. Tracing orphaned events is a phase-three activity that is inefficient without first knowing whether client events exceed backend records or vice versa.

    Read the full bite: What causes client order_completed events to diverge from backend records?

  8. Question 8 of 30

    Which statement accurately describes how analytics SDKs handle anonymous events after a user later identifies on a different device?

    Show the answer

    Answer: d · The backend maintains a merge queue to alias anonymousIds to the canonical userId, even when events arrive out of order.

    The backend resolves identity server-side by aliasing device-scoped anonymousIds to the canonical userId through an identity graph or merge queue, handling out-of-order and cross-device events automatically. Option A is wrong because SDKs do not rewrite old events client-side; attribution happens downstream in the pipeline.

    Read the full bite: Explain user identity stitching across devices and SDK roles

  9. Question 9 of 30

    To isolate the effect of loss-aversion versus gain framing at checkout, which assignment approach ensures the same shopper always sees the same variant and avoids within-subject contamination?

    Show the answer

    Answer: a · Assign using a hash of the stable user ID before the checkout page renders

    The card requires a stable user-level unit of diversion and pre-allocation before rendering to prevent contamination and flicker bias. Session-level randomization is explicitly flagged as a red flag because it splits users across variants and invalidates the experiment.

    Read the full bite: Design an A/B test for loss aversion versus gain framing at checkout

  10. Question 10 of 30

    Which approach best satisfies both idempotency and anti-gaming requirements for a distributed daily-login reward system?

    Show the answer

    Answer: b · Compute a unique token from the user ID and rolling window, enforce a database unique constraint on that token, and resolve probabilities using server-side campaign weights.

    Option B is correct because a rolling window prevents timezone gaming, the database unique constraint on the token guarantees idempotency, and server-side weights prevent tampering. Option A is tempting because it mentions server-side logic, but calendar-day checks are vulnerable to timezone manipulation and Redis-only storage lacks the persistent constraint needed to prevent duplicate grants under retries.

    Read the full bite: Design a variable daily-login reward system with anti-gaming controls

  11. Question 11 of 30

    Which expiration pipeline best prevents a thundering herd when handling millions of trials at scale?

    Show the answer

    Answer: d · Enqueue a delayed message per user that becomes visible exactly at their ends_at timestamp

    Delayed messages per user avoid scanning millions of rows and eliminate thundering herds. C is tempting because it shards work, but the card explicitly prefers per-user delayed events, while A and B are common anti-patterns.

    Read the full bite: Design the data model and backend for a 7-day trial at scale

  12. Question 12 of 30

    In RICE scoring, what failure mode does the Confidence multiplier specifically guard against?

    Show the answer

    Answer: b · Letting optimistic but unsupported estimates outrank evidence-backed ideas

    Confidence discounts Reach and Impact by how much evidence supports them, stopping speculative bets from beating proven ones. It does not estimate effort, deduplicate users, or select metrics.

    Read the full bite: Explain RICE scoring and its Confidence factor

  13. Question 13 of 30

    Before writing a MECLABS hypothesis for a 40% email verification drop-off, what is the most critical initial action?

    Show the answer

    Answer: c · Segment the 40% drop by device, geo, and delivery latency to locate the leak

    The card states that diagnostic segmentation must come first because the aggregate 40% number hides whether the leak stems from deliverability, mobile UX, or motivation. Option A is tempting because isolating a variable is essential, but doing so before segmentation risks solving the wrong problem.

    Read the full bite: Develop a testable hypothesis for a 40% email verification drop-off

  14. Question 14 of 30

    When running an experiment to increase CTA clicks, which best describes the proper role of a guardrail metric like revenue per user?

    Show the answer

    Answer: c · It requires a pre-set non-inferiority threshold and halts the experiment if breached, regardless of CTA lift.

    Guardrails are hard safety limits with pre-set non-inferiority thresholds that trigger an experiment stop if breached, even when the primary metric wins. Treating them as secondary success metrics reviewed only after the primary metric succeeds is a common misconception that risks silently damaging the business.

    Read the full bite: When increasing CTA clicks, what side-effects and guardrails should you consider?

  15. Question 15 of 30

    What is the primary reason to pair quantitative analytics with qualitative interviews when forming an experiment hypothesis?

    Show the answer

    Answer: a · Analytics show what and where a problem is, while interviews reveal why it happens

    Quant locates and sizes the behavior; qual explains the underlying motivation, so together they produce a grounded, testable hypothesis. Interviews do not confer statistical significance, replace control groups, or remove the need for a metric.

    Read the full bite: Combine qualitative and quantitative data for hypotheses

  16. Question 16 of 30

    An experiment needs 60,000 users per variant to detect a 5% lift with 80% power. Why does detecting a 2% lift at the same power require 370,000 users?

    Show the answer

    Answer: b · Because the test must distinguish a weaker signal from the same random noise

    The card explains that shrinking the MDE inflates sample size because you are asking the test to resolve a smaller signal from the same noise. Distractor C reflects the common misconception of conflating power/MDE with the false positive rate (alpha), which is held constant.

    Read the full bite: Explain statistical power, MDE, and sample size impact

  17. Question 17 of 30

    When implementing a last-touch attribution model in your warehouse, which approach correctly assigns credit for a signup?

    Show the answer

    Answer: a · Select touches falling within 30 days before the signup, then use a window function to keep only the latest touch per user.

    Option A is correct because it applies the 30-day lookback window and uses a window function to isolate the final eligible touch per user. Option D is tempting but wrong because ignoring the lookback window could credit a touch from months before the signup, which violates the model's intent.

    Read the full bite: How would you implement a last-touch attribution model for user signups?

  18. Question 18 of 30

    When bucketing anonymous paid-ad traffic for a signup-flow A/B test, which approach best satisfies speed, scale, and isolation requirements?

    Show the answer

    Answer: c · Compute a deterministic hash of the anonymous ID salted with the experiment ID at the landing page, store the variant in a cookie, and skip database lookups entirely.

    Deterministic hashing with experiment salting at the landing page eliminates database latency and prevents cross-experiment correlation, while persisting the variant in a cookie maintains session consistency. Option B is tempting because database storage feels reliable, but delaying assignment until after signup starts severs attribution from the paid ad click and invalidates the experiment.

    Read the full bite: Architect an A/B test for paid-ad signup flows

  19. Question 19 of 30

    After observing that users who create a Project within 24 hours have significantly higher D30 retention, what is the most rigorous next step to establish causality?

    Show the answer

    Answer: c · Compare the groups after controlling for confounders such as acquisition channel and role, then recommend a randomized nudge experiment

    Controlling for confounders such as acquisition channel and role addresses self-selection bias, and only a randomized nudge experiment can close the causal gap. Extending the analysis to D90 remains observational and still confuses correlation with causation.

    Read the full bite: How would you validate that early Project creation drives retention?

  20. Question 20 of 30

    Which architecture best balances cross-device resume, offline safety, and anonymous user tracking in a multi-step onboarding flow?

    Show the answer

    Answer: a · Use debounced server-side storage with localStorage fallback, timestamped granular fields, and anonymous tokens for unauthenticated users.

    Option A is correct because debounced server sync with localStorage fallback handles cross-device resume and offline gaps, while granular timestamps and anonymous tokens address conflicts and unauthenticated users. Option C is tempting because server storage feels durable, but without a client-side cache, a tab closed before the network request completes loses the latest state.

    Read the full bite: How would you design resumable multi-step onboarding state management?

  21. Question 21 of 30

    Which architecture lets product teams add new onboarding roles without engineering deploys while supporting multi-channel delivery?

    Show the answer

    Answer: c · Keep content in a CMS, use a centralized service to evaluate role-based rules, and deliver across in-app and email channels

    Option C is correct because decoupling content into a CMS with a centralized rule engine enables non-engineers to add roles while multi-channel delivery supports the full onboarding journey. Option B is tempting because it uses a CMS, but keeping rule evaluation and rendering client-side still couples logic to the frontend and prevents scalable orchestration across channels.

    Read the full bite: Design a role-based personalized onboarding system

  22. Question 22 of 30

    Why is deterministic bucketing preferred over client-side random assignment in a Buy Now button A/B test?

    Show the answer

    Answer: a · It prevents users from reshuffling variants across visits, preserving statistical independence

    Deterministic hashing guarantees the same user always lands in the same bucket, whereas Math.random reshuffles users on every visit and breaks statistical independence. Option D is tempting because candidates often want to simplify telemetry, but omitting impression events makes it impossible to compute click-through rates or detect sample ratio mismatch.

    Read the full bite: Design an A/B test for a Buy Now button

  23. Question 23 of 30

    Which architecture best protects the primary database and minimizes wasted compute for a weekly digest at scale?

    Show the answer

    Answer: b · Populate a separate digest store via stream processing and check unsubscribes at both enqueue and send time

    The correct approach offloads read traffic to a pre-aggregated store and filters unsubscribes before enqueue to avoid wasted render work. Option D is tempting because it uses the right data model, but checking unsubscribes only at send time still wastes compute generating emails that must be dropped.

    Read the full bite: Outline architecture for a weekly email digest of unread notifications

  24. Question 24 of 30

    When designing a hybrid feed system that switches between fan-out-on-write and fan-out-on-read, how should you determine the follower threshold T?

    Show the answer

    Answer: a · Derive T from operational write throughput limits and the system's post rate

    The card specifies that T should be calculated from operational limits like acceptable write throughput divided by post rate, not guessed or based on averages. Option C confuses average distribution with peak write capacity, while D treats the threshold as an arbitrary constant rather than a derived operational bound.

    Read the full bite: Compare fan-out-on-write vs fan-out-on-read for an activity feed

  25. Question 25 of 30

    What is the correct approach to prevent a user from being re-bucketed into a different variant when they switch from mobile to desktop?

    Show the answer

    Answer: b · Provide the SDK with one stable user ID that persists across devices via authentication or first-party cookies

    A stable user ID lets the SDK hash the same value to return the identical variation on any device and allows conversion events to join back to the original bucket. Device-specific IDs re-bucket the user, inflating visitor counts and destroying statistical validity.

    Read the full bite: How do you ensure consistent A/B test variants across sessions and devices?

  26. Question 26 of 30

    A subscription enters the past_due state after a renewal failure, yet the customer continues to have feature access during the grace period. Which architectural choice makes this possible?

    Show the answer

    Answer: c · Access decisions are made by an entitlements layer that reads both subscription state and payment state independently

    An entitlements layer decouples feature access from the subscription state machine, allowing grace-period access while the subscription is legitimately past_due. Simply keeping the subscription active until dunning exhausts confuses payment failure tracking with access control and prevents accurate revenue recovery workflows.

    Read the full bite: Design a system to handle subscription renewals

  27. Question 27 of 30

    An analytics team tracks every purchase and CAC but estimates LTV by dividing total revenue by total users. Which instrumentation-driven modeling component corrects this overestimation?

    Show the answer

    Answer: a · Cohort survival curves built from user activity and renewal events

    Dividing total revenue by users assumes everyone stays active indefinitely; cohort survival curves use event-level retention data to probability-weight future revenue. Discounting (C) refines the value of future cash but does not fix the core churn assumption.

    Read the full bite: How would you instrument an application to calculate Customer Lifetime Value?

  28. Question 28 of 30

    Which pairing correctly contrasts the authorization and data architectures of freemium and free trial models?

    Show the answer

    Answer: b · Freemium requires persistent tiered feature flags per user, while trials need a time-bomb access layer that degrades at expiration

    Freemium architecture permanently gates features through tiered entitlement matrices, while trials use time-scoped access layers that degrade when the clock expires. Option C is a tempting distractor because a simple boolean paid flag is a common misconception that collapses the distinction between feature scarcity and time scarcity.

    Read the full bite: What are the key architectural differences between freemium and free trial models?

  29. Question 29 of 30

    Which design best handles the requirement that reward payouts must be retried independently when downstream payment providers fail?

    Show the answer

    Answer: a · Use a separate rewards table with an idempotency_key and enqueue payout jobs asynchronously

    The card recommends a separate rewards table with an idempotency_key so failed payouts can be retried independently without duplicates. Option C represents the anti-pattern of collapsing reward state into the referrals table, which prevents isolated retries.

    Read the full bite: Design referral tracking from invite to conversion

  30. Question 30 of 30

    Which architecture best balances technical correctness and conversion optimization for a 3-project freemium limit?

    Show the answer

    Answer: d · Use an entitlement service with atomic limit checks, return structured denials to trigger contextual upsell modals, and apply upgrades via async billing webhooks

    The correct approach separates concerns by using an atomic entitlement service, preserving conversion momentum with contextual upsells, and decoupling billing via async webhooks. Option C is tempting but fundamentally unsafe because frontend checks are easily bypassed and a generic 403 offers no upgrade path.

    Read the full bite: How would you enforce a 3-project freemium limit and handle upgrades?

Could you explain these out loud?

That is what an interview actually tests. Tezvyn gives you questions like these with what the interviewer is really checking, the answer that lands, and the mistake that ends the conversation, in the four minutes before your next meeting.

The iPhone app is on the way

We are building it. Until it lands, nothing here is held back from you: every interview card, your saved cards, streaks and the job board all work in Safari, plus hundreds of free practice quizzes of thirty questions each. Sign in and it all carries over to the app the day it arrives.

Want it as an icon? Tap Share at the bottom of Safari, then Add to Home Screen. It opens full screen and the cards you have read stay available offline.

Get it on Google PlayiPhone app coming soon