Top 30 Experimentation Interview Questions and Answers

30 questions. Pick an answer, or open “Show the answer” to read it.

Answers are graded in your browser. Nothing is saved, and no XP or streak is earned here. The app keeps score.

1. Question 1 of 30

   What fundamental challenge does High-Tempo Testing primarily aim to overcome for businesses?

   • aThe difficulty in establishing product-market fit for new offerings.
   • bThe high cost associated with traditional, large-scale marketing campaigns.
   • cThe inherent volatility and rapid decay of customer acquisition channels.
   • dThe lack of a centralized system for managing all marketing initiatives.
   Show the answer

   Answer: c · The inherent volatility and rapid decay of customer acquisition channels.

   The card explicitly states that High-Tempo Testing exists because 'customer acquisition channels are more crowded and volatile than ever' and 'decay quickly.' It is designed to find new growth levers before old ones expire due to this volatility. Option A is incorrect because the card states this approach is 'premature for pre-product-market fit companies.'

   Read the full bite: High-Tempo Testing: Move Faster Than Your Channels Decay

2. Question 2 of 30

   A growth team boosts WAU with aggressive push notifications. Which counter metric most directly reveals shallow engagement caused by the campaign?

   • aSessions per user per week
   • b7-day retention rate
   • cLifetime value
   • dClient-side error rate
   Show the answer

   Answer: a · Sessions per user per week

   The card maps sessions per user to shallow engagement from notification spam, whereas 7-day retention tracks churn risk, making it the most tempting distractor because it is a valid counter metric but for a different problem. Lifetime value is explicitly called out as a lagging business outcome, not a real-time UX health signal.

   Read the full bite: What counter metrics track health of weekly active users?

3. Question 3 of 30

   According to the card, what is the primary challenge when using the ICE scoring framework?

   • aIt often leads to endless debates among team members about prioritization.
   • bIt is primarily designed for marketing teams, limiting its applicability across departments.
   • cIt requires a complex calculation method that can slow down decision-making.
   • dThe lack of objective data can lead to inconsistent and opinion-based scores.
   Show the answer

   Answer: d · The lack of objective data can lead to inconsistent and opinion-based scores.

   The card states, "The biggest weakness of ICE is subjectivity. If your team lacks historical data or a shared understanding to calibrate against, scores for Impact and Confidence can be inconsistent and based on opinion." Option A is incorrect because ICE is designed to avoid endless debate.

   Read the full bite: ICE Score: A Quick Framework for Prioritizing Ideas

4. Question 4 of 30

   According to the Lean Startup methodology, what is the fundamental trigger for a company to execute a pivot?

   • aValidated learning from an MVP demonstrates that a core strategic hypothesis about the product or customer is incorrect.
   • bCustomer support receives a high volume of complaints about a specific feature, indicating a need for immediate change.
   • cThe company's initial product launch fails to gain significant traction, leading to a decision to restart development from scratch.
   • dThe executive team decides to pursue a more lucrative market segment identified through competitive analysis.
   Show the answer

   Answer: a · Validated learning from an MVP demonstrates that a core strategic hypothesis about the product or customer is incorrect.

   The card explicitly states a pivot is triggered by "validated learning from your MVP when data shows your initial hypothesis was wrong." Option A directly reflects this. Option C is incorrect because a pivot is a structured course correction of strategy, not a "restart" or abandonment of the original vision.

   Read the full bite: The Pivot: A Structured Change in Strategy, Not Vision

5. Question 5 of 30

   Which approach to instrumenting an A/B test event best ensures trustworthy, maintainable experiment data?

   • aLog unstructured events and formalize the schema after the feature launches
   • bUse different field names in dev and production to keep environments separate
   • cDefine a tracking plan with minimal scoped properties, environment flags, and consistent naming conventions
   • dInclude every available user and device attribute so analysts can decide later what matters
   Show the answer

   Answer: c · Define a tracking plan with minimal scoped properties, environment flags, and consistent naming conventions

   A disciplined tracking plan with minimal, explicitly scoped properties and environment separation creates a trustworthy contract between engineering and analytics. Option D is tempting because flexibility sounds useful, but dumping every attribute creates a data swamp that breaks the single source of truth and makes schemas unmaintainable.

   Read the full bite: What fields belong in an experiment tracking event?

6. Question 6 of 30

   A new feature's adoption is flat. Data shows 80% of eligible users never click the entry point, but those who do complete the core action. What should the diagnostic plan prioritize?

   • aRedesign the feature interface to reduce friction in the core workflow
   • bInterview random users to understand why the feature lacks perceived value
   • cInvestigate discovery barriers and experiment with awareness interventions like contextual prompts
   • dBuild a long-term dashboard to track adoption metrics across all user segments
   Show the answer

   Answer: c · Investigate discovery barriers and experiment with awareness interventions like contextual prompts

   High completion among users who find the feature indicates a discovery barrier, not usability or value. Redesigning the interface (A) misdiagnoses the bottleneck, while random interviews (B) ignore the behavioral signal that already pinpoints where users drop off.

   Read the full bite: How do you diagnose why a new feature's adoption is flat?

7. Question 7 of 30

   A checkout A/B test shows significantly higher conversion but slightly lower AOV. What is the strongest basis for a launch recommendation?

   • aLaunch because conversion is up and automatically outweighs any decrease in basket size
   • bRequire AOV to also achieve statistical significance as a co-success metric
   • cAdjust p-values for multiple comparisons and launch only if both metrics remain significant
   • dEstimate net revenue and ensure the AOV decline is within a pre-specified non-inferiority margin
   Show the answer

   Answer: d · Estimate net revenue and ensure the AOV decline is within a pre-specified non-inferiority margin

   The right framework classifies conversion as a success metric and AOV as a guardrail requiring non-inferiority, then uses net revenue to judge the business outcome. Treating AOV as a co-success metric that must significantly increase is a tempting error that causes unnecessary conservatism and missed wins.

   Read the full bite: How would you recommend launching a checkout flow with mixed A/B metrics?

8. Question 8 of 30

   Which approach correctly implements the Effort component in an automated RICE scoring pipeline?

   • aCount distinct users from event streams over a fixed window using an experiment registry to attribute them to initiatives
   • bIngest application logs and compute code complexity metrics to algorithmically derive person-months
   • cUse story points from PM tools directly as person-months without velocity conversion or calibration
   • dPull estimates from project management APIs, convert to person-months using historical velocity, and calibrate for optimism
   Show the answer

   Answer: d · Pull estimates from project management APIs, convert to person-months using historical velocity, and calibrate for optimism

   Effort is correctly built by pulling PM estimates, converting them to person-months via historical velocity, and calibrating for optimism because human estimates are systematically optimistic. Option B represents the common red flag of attempting to derive Effort from code complexity or logs, which cannot replace human estimation.

   Read the full bite: Describe RICE scoring and architect data pipelines for Reach and Effort

9. Question 9 of 30

   Which approach best minimizes interaction bias across concurrent experiments while preserving platform velocity?

   • aApply mutual exclusion globally so each user sees only one experiment at a time
   • bReduce traffic percentages for each experiment so overlaps are uncommon
   • cAssign users randomly to all experiments and add interaction terms during analysis
   • dUse orthogonal layers with reservation amounts, restricting mutual exclusion to tightly coupled features
   Show the answer

   Answer: d · Use orthogonal layers with reservation amounts, restricting mutual exclusion to tightly coupled features

   Orthogonal layers isolate independent experiments via separate randomization units and reservation amounts prevent layer starvation, while mutual exclusion is reserved for high-risk features because global use destroys velocity. The most tempting distractor, adding post-hoc interaction terms, fails because clean causal inference requires designed allocation—regression cannot fix unstructured overlaps after the fact.

   Read the full bite: How do you design allocation logic to minimize concurrent A/B test interactions?

10. Question 10 of 30

    When A/B testing sign-up button copy, which practice ensures you can accurately attribute differences in sign-ups to the copy change?

    • aRandomly assign users to variants using a hashed user ID, track impressions and conversions, and compare conversion rates
    • bShow version A for one week and version B for the next to avoid overlap
    • cSplit users by geolocation and compare sign-up counts across regions after two weeks
    • dTrack button clicks for each variant and compare click counts, assuming more clicks lead to more sign-ups
    Show the answer

    Answer: a · Randomly assign users to variants using a hashed user ID, track impressions and conversions, and compare conversion rates

    Randomizing with hashed user IDs and tracking both impressions and completed sign-ups lets you calculate a true conversion rate and establish causality. Sequential testing introduces temporal bias because traffic composition and external factors differ between weeks, invalidating the comparison.

    Read the full bite: How would you A/B test sign-up button copy and measure results?

11. Question 11 of 30

    Why is the correlation between profile completion and retention weak evidence that forcing completion will improve retention?

    • aCorrelation coefficients cannot apply to user behavior data
    • bRetention can never be measured accurately for new users
    • cThe sample of completed profiles is always too small to trust
    • dEngaged users self-select into completing profiles, confounding the relationship
    Show the answer

    Answer: d · Engaged users self-select into completing profiles, confounding the relationship

    Motivated users both complete profiles and retain, so engagement is a confounder making completion a marker rather than a proven cause. A randomized experiment is needed; the other options misstate the actual problem.

    Read the full bite: Does forcing profile completion cause retention?

12. Question 12 of 30

    What is the most important addition to a revenue metric when evaluating a change that may harm long-term satisfaction?

    • aMeasuring revenue more precisely with a larger sample
    • bLong-horizon guardrail metrics like retention plus a sufficiently long experiment
    • cShipping quickly to capture the revenue before users notice
    • dRelying on stakeholder intuition about user happiness
    Show the answer

    Answer: b · Long-horizon guardrail metrics like retention plus a sufficiently long experiment

    Long-term harm surfaces as delayed churn, so guardrail metrics measured over a long-enough window are essential to weigh against the immediate revenue lift. More precise short-term revenue alone still misses the delayed retention cost.

    Read the full bite: Framing ad-load tradeoffs: revenue versus retention

13. Question 13 of 30

    Your team wants to measure six-month LTV impact of a pricing change. Which architecture avoids survivorship bias and cross-experiment collision traps common in long-term holdbacks?

    • aAssign users with a deterministic hash on a durable account ID, check a dedicated holdback flag before any regular experiment flags, seal metrics only after the observation window plus a bounded grace period, and use clustered standard errors with an intent-to-treat model.
    • bBucket users deterministically by device ID, compute long-term lift incrementally with weekly batch jobs, and limit the analysis set to users who were exposed to the new pricing UI at least once.
    • cRe-randomize remaining active users monthly to keep groups balanced, store group membership in browser cookies, and compare mean revenue among users still active at month six using a standard t-test.
    • dUse the standard A/B test framework with weekly re-randomization of unresponsive users, evaluate the holdback flag after regular experiment flags to prevent override, and apply standard t-tests on all originally enrolled users.
    Show the answer

    Answer: a · Assign users with a deterministic hash on a durable account ID, check a dedicated holdback flag before any regular experiment flags, seal metrics only after the observation window plus a bounded grace period, and use clustered standard errors with an intent-to-treat model.

    Option A is correct because it pins users indefinitely with durable identity storage, isolates the holdback from newer experiments via namespace ordering, seals metrics only after the full window closes, and uses intent-to-treat with clustered errors to avoid survivorship bias. Option B is tempting because deterministic bucketing is correct, but device IDs are not durable across reinstalls, incremental computation violates the sealed observation window, and analyzing only exposed users creates survivorship bias by dropping unexposed bucketed users.

    Read the full bite: How would you architect long-term holdback experiment groups?

14. Question 14 of 30

    Why is capturing failed and flat experiment results just as important as winning ones in a company-wide experimentation dashboard?

    • aThey automatically improve the win rate of future tests
    • bThey prevent teams from repeating ideas that have already been disproven
    • cFailed results raise the average statistical power of the platform
    • dNegative results are required to compute confidence intervals
    Show the answer

    Answer: b · They prevent teams from repeating ideas that have already been disproven

    Recording what did not work builds institutional memory so teams avoid redundant or already-disproven experiments. Failed results do not change statistical power or confidence-interval math, and they do not mechanically raise future win rates.

    Read the full bite: Architect an experimentation dashboard for culture

15. Question 15 of 30

    Which method best persists marketing campaign attribution from a user's first visit through to their eventual signup?

    • aUse Facebook Pixel and Google Ads conversion tags as the sole record of which campaign drove the signup
    • bRely on the HTTP referer header when the user submits the signup form
    • cParse UTM parameters on arrival, store them in a first-party cookie, and read the cookie at signup
    • dAsk users to select how they heard about you during registration
    Show the answer

    Answer: c · Parse UTM parameters on arrival, store them in a first-party cookie, and read the cookie at signup

    Parsing UTM parameters into a first-party cookie preserves the original campaign source across browsing sessions until the user completes signup. Relying solely on ad platform conversion tags is insufficient because it prevents independent reconciliation and omits sources like organic blog traffic.

    Read the full bite: How do you attribute signups to Facebook, Google, and blog campaigns?

16. Question 16 of 30

    Which hypothesis pair best tests whether a green signup button increases registrations compared to blue?

    • aH0: There is no difference in registration conversion rate; H1: The registration conversion rates are not equal.
    • bH0: The registration conversion rate for green equals that for blue; H1: The registration conversion rate for green is strictly greater than that for blue.
    • cH0: The blue button has a higher registration conversion rate than the green button; H1: The green button has a higher registration conversion rate than the blue button.
    • dH0: The green and blue buttons perform the same; H1: The green button performs better.
    Show the answer

    Answer: b · H0: The registration conversion rate for green equals that for blue; H1: The registration conversion rate for green is strictly greater than that for blue.

    The correct answer frames H0 as no difference and H1 as a directional increase in the specific metric, matching the one-tailed nature of the business question. Option A is tempting because it uses 'no difference,' but it wrongly uses a two-tailed alternative that ignores the directional ask and wastes statistical power.

    Read the full bite: What are your null and alternative hypotheses for this A/B test?

17. Question 17 of 30

    In a three-step funnel, how do you correctly calculate relative conversion between step two and step three?

    • aDivide unique users at step three by unique users at step one
    • bDerive the drop-off from the difference in pageviews between step two and step three
    • cDivide unique users at step three by unique users at step two
    • dDivide raw event counts at step three by raw event counts at step two
    Show the answer

    Answer: c · Divide unique users at step three by unique users at step two

    Relative conversion between adjacent steps requires dividing unique users at step N by unique users at the previous step. Option A measures overall conversion from the top, option D inflates numbers with refreshes, and option B relies on page differences that hide exactly where users quit.

    Read the full bite: How do you track events and calculate funnel drop-off?

18. Question 18 of 30

    What is the primary reason to implement attribution modeling in a marketing strategy?

    • aTo identify the single marketing channel responsible for the majority of conversions.
    • bTo reduce the overall number of marketing channels required for a successful campaign.
    • cTo automatically clean and standardize marketing data from disparate sources.
    • dTo accurately distribute credit across various touchpoints in a customer's conversion path.
    Show the answer

    Answer: d · To accurately distribute credit across various touchpoints in a customer's conversion path.

    The core purpose of attribution modeling is to untangle complex customer journeys and assign appropriate value to each marketing touchpoint, as stated in the card. Option A is a common misconception, as attribution modeling aims to understand the contribution of multiple channels, not just identify a single one, and simplistic models are warned against.

    Read the full bite: Attribution Modeling: Who Gets Credit for a Conversion?

19. Question 19 of 30

    In a production Thompson Sampling bandit serving headlines with delayed click feedback, which design best balances real-time serving with robust learning?

    • aAllocate traffic randomly for a fixed burn-in period before committing fully to the highest posterior mean
    • bMaintain a minimum traffic percentage per headline and process attributed clicks through an async update pipeline
    • cReserve a small random holdout bucket and feed its outcomes directly into the main bandit's posterior updates
    • dRun nightly batch updates to recalculate Beta posteriors after all clicks are attributed
    Show the answer

    Answer: b · Maintain a minimum traffic percentage per headline and process attributed clicks through an async update pipeline

    Option B correctly combines an exploration floor, which prevents new headlines from being starved before proving themselves, with an async pipeline that handles delayed, out-of-order feedback. Option D represents the common mistake of ignoring real-time constraints with batch updates, while Option A risks premature convergence through greedy allocation.

    Read the full bite: Propose a multi-armed bandit system to optimize headlines faster

20. Question 20 of 30

    What is the main reason people tend to rely on social proof, according to the card?

    • aTo avoid taking personal responsibility for their choices.
    • bTo confirm that their own expert analysis is correct.
    • cTo simplify decision-making when they lack complete information.
    • dTo ensure they always select the highest quality option available.
    Show the answer

    Answer: c · To simplify decision-making when they lack complete information.

    The card explains that social proof provides a "low-energy heuristic" and a "shortcut to make decisions without conducting exhaustive research" when people are faced with uncertainty. While people might hope for high quality, social proof does not guarantee the best outcome, as "the crowd can be wrong or even faked."

    Read the full bite: Social Proof: People Copy People

21. Question 21 of 30

    In a two-proportion conversion test, which change most directly explains why detecting a 2% relative lift requires roughly 390k users per variant instead of 63k for a 5% relative lift?

    • aThe absolute MDE shrinks from 0.5 to 0.2 percentage points, and sample size scales roughly with the inverse square of the absolute effect size.
    • bLowering the relative lift from 5% to 2% reduces statistical power from 80% to approximately 20% unless sample size is inflated.
    • cThe standard error of a proportion depends on p(1-p), which drops nonlinearly when the treatment rate approaches the baseline rate.
    • dThe baseline conversion rate of 10% creates a ceiling effect that exponentially increases variance as the relative lift decreases.
    Show the answer

    Answer: a · The absolute MDE shrinks from 0.5 to 0.2 percentage points, and sample size scales roughly with the inverse square of the absolute effect size.

    The correct answer identifies that the absolute MDE falls from 0.5 to 0.2 percentage points, and because N is roughly proportional to the inverse square of the absolute MDE, required sample size balloons by about sixfold. Distractor D is tempting because it quotes the true p(1-p) variance formula from the card, but in this range variance barely changes and cannot explain the explosion in sample size.

    Read the full bite: How do you determine sample size for a conversion lift experiment?

22. Question 22 of 30

    When architecting a global notification holdout, which combination of design choices preserves longitudinal measurement while ensuring critical transactional messages are never suppressed?

    • aHash the user ID with a holdout salt, persist the assignment, evaluate at decision time in the notification service, and bypass the check for transactional messages
    • bCompute holdout segments in a nightly batch job and apply them uniformly to both marketing and transactional messages
    • cUse per-request random assignment evaluated at send time with a single namespace for all message types
    • dStore holdout state in a client-side cookie and evaluate upstream in the marketing automation tool before dispatch
    Show the answer

    Answer: a · Hash the user ID with a holdout salt, persist the assignment, evaluate at decision time in the notification service, and bypass the check for transactional messages

    Deterministic sticky bucketing by user ID ensures consistent exclusion across sessions for valid longitudinal measurement, while namespace separation guarantees transactional messages bypass the holdout entirely. Option C is tempting because evaluation at send time is correct, but per-request random assignment destroys statistical validity by causing users to bounce in and out of the holdout.

    Read the full bite: How do you architect a global notification holdback group?

23. Question 23 of 30

    A product team wants to test if a new onboarding flow increases profile completion. Which experimental design best aligns with a technical MVP approach for quantitative validation?

    • aLaunch a landing page describing faster onboarding and track waitlist sign-ups as a proxy for completion intent
    • bConduct five user interviews and ask participants to rate how likely they are to complete the new flow
    • cServe the new flow to 10% of users via a feature flag, instrument each step against a control group, and define a kill threshold before launch
    • dRebuild the onboarding flow for all users and measure the change in profile completion rate over two weeks
    Show the answer

    Answer: c · Serve the new flow to 10% of users via a feature flag, instrument each step against a control group, and define a kill threshold before launch

    Option C is correct because it limits exposure via a feature flag, instruments funnel events, maintains a control group for causality, and sets a kill threshold, all core to the disciplined experiment framework described. Option D is tempting because it tracks the exact KPI, but shipping a full build to all users without a concurrent control or predefined guardrails violates the principle of learning before scaling.

    Read the full bite: Describe a technical MVP approach to validate user engagement quantitatively

24. Question 24 of 30

    A product team observes low engagement with a new feature, despite initial user feedback indicating high interest. Based on the Fogg Behavior Model, which intervention is often the most effective first step to increase usage?

    • aRedesign the feature to reduce the number of steps required for completion.
    • bImplement a new onboarding flow to educate users on the feature's benefits.
    • cOffer incentives or rewards for users who successfully use the feature.
    • dIncrease the frequency and prominence of in-app prompts for the feature.
    Show the answer

    Answer: a · Redesign the feature to reduce the number of steps required for completion.

    The card emphasizes that 'making a task simpler is often the most effective way to increase behavior' and warns against blaming low motivation when low ability is the actual issue. Reducing steps directly addresses ability, making the behavior easier to perform. While increasing motivation or prompts can help, improving ability is frequently the most impactful initial lever.

    Read the full bite: Fogg Behavior Model: Why Users Act (or Don't)

25. Question 25 of 30

    According to the card, how does anchoring bias primarily influence subsequent judgments?

    • aIt causes individuals to prioritize the first piece of information as the most accurate.
    • bIt enhances the ability to generate entirely new estimations without relying on external cues.
    • cIt leads to an insufficient adjustment from the initial reference point when making further estimations.
    • dIt makes people more likely to accept the first offer in a negotiation without further consideration.
    Show the answer

    Answer: c · It leads to an insufficient adjustment from the initial reference point when making further estimations.

    The card explicitly states, "Your final judgment is an adjustment from that anchor, but the adjustment is often insufficient." This highlights that the bias works by tethering subsequent thoughts to the initial number, leading to inadequate deviation from it. Option A is incorrect because the bias doesn't necessarily make the first information accurate, but rather makes it a reference point from which adjustments are made, often insufficiently.

    Read the full bite: Anchoring Bias: The First Number You See Matters Most

26. Question 26 of 30

    A platform running dozens of simultaneous A/B tests must scale from ten thousand to one million users without cascading failures or corrupted results. Which architectural choice best achieves both goals?

    • aConsolidate feature flags, user assignment, and analytics into one monolithic service that queries the production database directly for real-time metrics.
    • bDeploy separate microservices for assignment and analytics, but have them communicate via synchronous REST and let the metrics pipeline poll the production database for changes.
    • cRoute every user action through synchronous calls to the analytics warehouse and isolate load by having the assignment service and metrics pipeline read from different database replicas.
    • dUse independent event-driven services connected by an event bus, feed the metrics pipeline via change data capture, and resolve user segments from a low-latency cache at assignment time.
    Show the answer

    Answer: d · Use independent event-driven services connected by an event bus, feed the metrics pipeline via change data capture, and resolve user segments from a low-latency cache at assignment time.

    Asynchronous event-driven services with change data capture isolate production load while keeping assignments and metrics perfectly aligned; the tempting distractor suggesting separate database replicas introduces replication lag that corrupts experiment results by misattributing events to variants.

    Read the full bite: How would you architect a system for rapid experimentation and validation?

27. Question 27 of 30

    What is the primary distinction between an ethical "nudge" and a "dark pattern" in influencing user behavior?

    • aNudges are always transparent about their intent, while dark patterns are intentionally deceptive.
    • bA nudge relies on direct commands, while a dark pattern uses subtle environmental cues.
    • cNudges remove undesirable choices, while dark patterns add more options to confuse users.
    • dA nudge aims to benefit the user, whereas a dark pattern prioritizes business gain at the user's expense.
    Show the answer

    Answer: d · A nudge aims to benefit the user, whereas a dark pattern prioritizes business gain at the user's expense.

    The card explicitly defines a 'dark pattern' as a nudge that primarily benefits the business at the user's expense, contrasting it with ethical nudges that aim for user well-being. Nudges are designed to maintain freedom of choice, not remove options, by making beneficial choices easier or more salient.

    Read the full bite: Nudge Theory: Shaping Choices Without Forcing Them

28. Question 28 of 30

    According to the variable rewards model, why are unpredictable payoffs generally more effective for sustained user engagement than consistent, guaranteed rewards?

    • aThey build user trust by consistently delivering on expected outcomes.
    • bThey prevent user fatigue by ensuring a reward for every interaction.
    • cThey reduce the cognitive load on users by making outcomes straightforward.
    • dThey generate a stronger sense of anticipation and excitement, driving repeated behavior.
    Show the answer

    Answer: d · They generate a stronger sense of anticipation and excitement, driving repeated behavior.

    The card explains that unpredictable rewards create a sense of anticipation and excitement, which is a more powerful motivator for continued engagement than guaranteed, static outcomes. The other options describe characteristics that are either opposite to variable rewards or misinterpret their mechanism.

    Read the full bite: Variable Rewards: The Engine of Habit

29. Question 29 of 30

    Which psychological principle is identified as the primary driver behind the Endowment Effect, according to the provided card?

    • aCognitive dissonance, arising from the conflict between owning something and considering its objective market value.
    • bLoss aversion, causing the pain of parting with an item to outweigh the pleasure of an equivalent gain.
    • cConfirmation bias, leading individuals to seek data that validates their ownership.
    • dAnchoring bias, where the initial price or perceived value sets an immovable reference point.
    Show the answer

    Answer: b · Loss aversion, causing the pain of parting with an item to outweigh the pleasure of an equivalent gain.

    The card explicitly states that the endowment effect is explained by loss aversion, where the pain of losing something one owns is felt more acutely than the pleasure of gaining an equivalent item. While other biases might influence valuation, loss aversion is presented as the fundamental psychological basis for this effect.

    Read the full bite: The Endowment Effect: We Overvalue What We Already Own

30. Question 30 of 30

    To isolate the effect of loss-aversion versus gain framing at checkout, which assignment approach ensures the same shopper always sees the same variant and avoids within-subject contamination?

    • aAssign using a hash of the stable user ID before the checkout page renders
    • bSplit traffic by even and odd calendar days for the entire population
    • cRandomize by session so returning users may see either variant
    • dRotate the banner by time of day to control for traffic patterns
    Show the answer

    Answer: a · Assign using a hash of the stable user ID before the checkout page renders

    The card requires a stable user-level unit of diversion and pre-allocation before rendering to prevent contamination and flicker bias. Session-level randomization is explicitly flagged as a red flag because it splits users across variants and invalidates the experiment.

    Read the full bite: Design an A/B test for loss aversion versus gain framing at checkout