Top 30 Intermediate UX Research Concepts Quiz

30 questions. Pick an answer, or open “Show the answer” to read it.

Answers are graded in your browser. Nothing is saved, and no XP or streak is earned here. The app keeps score.

1. Question 1 of 30

   What is the primary distinction between the first and second diamonds in the Double Diamond model?

   • aThe first uses qualitative data, and the second uses quantitative data.
   • bThe first focuses on team building, while the second focuses on client feedback.
   • cThe first explores the problem space, and the second explores the solution space.
   • dThe first involves internal stakeholders, while the second involves external users.
   Show the answer

   Answer: c · The first explores the problem space, and the second explores the solution space.

   The card states, "The first diamond is for defining the right problem; the second is for building the right solution," clearly distinguishing their focus on problem exploration versus solution exploration. Option A is incorrect because both diamonds can involve various research methods, not just one type of data.

   Read the full bite: Double Diamond: Explore, Then Focus, Twice

2. Question 2 of 30

   Which approach best aligns with the core principle of the Jobs to Be Done framework?

   • aContinuously enhancing the features of an existing product
   • bStreamlining the production process to reduce product costs
   • cConducting market research to identify popular product trends
   • dUnderstanding the stable, underlying progress customers aim to make
   Show the answer

   Answer: d · Understanding the stable, underlying progress customers aim to make

   The Jobs to Be Done framework emphasizes identifying the stable, underlying 'job' a customer is trying to accomplish, which represents the progress they want to make. Option A focuses on improving the 'drill' (the product) rather than the 'hole' (the customer's ultimate goal), which JTBD advises against for strategic innovation.

   Read the full bite: Jobs to Be Done: Sell the Hole, Not the Drill

3. Question 3 of 30

   A product team is developing a new user onboarding flow and needs to identify specific areas where users struggle to improve the design before release. Which evaluation approach should they prioritize?

   • aFormative evaluation, to iteratively uncover and address usability issues.
   • bSummative evaluation, to measure the overall success rate of the new flow against a benchmark.
   • cQuantitative A/B testing, to determine which of two complete onboarding flows performs better.
   • dPost-release user surveys, to gather feedback on satisfaction and pain points from a broad audience.
   Show the answer

   Answer: a · Formative evaluation, to iteratively uncover and address usability issues.

   Formative evaluation is used to improve a design in progress by iteratively identifying and fixing flaws. Summative evaluation, on the other hand, judges a finished product's performance, making it unsuitable for diagnosing specific problems during development.

   Read the full bite: Formative vs. Summative Evaluation: Improve vs. Judge

4. Question 4 of 30

   When designing a new online service, which practice best exemplifies the principle of Data Minimization?

   • aRetaining all user interaction logs indefinitely to improve long-term user experience.
   • bAsking for only the information strictly necessary to provide the service's core functionality.
   • cCollecting a wide range of user demographics to enable future personalized features.
   • dImplementing robust encryption for all user data collected to prevent breaches.
   Show the answer

   Answer: b · Asking for only the information strictly necessary to provide the service's core functionality.

   Data Minimization dictates collecting only the data strictly necessary for a specific, legitimate purpose, as described in option B. Option C violates this by collecting data 'just-in-case' for potential future use, which is explicitly warned against in the card.

   Read the full bite: Data Minimization: Collect Only What You Need

5. Question 5 of 30

   What is the primary advantage of adopting a systematic information security management system (ISMS) for research data?

   • aIt provides a continuous, structured approach to identify and mitigate data security risks.
   • bIt primarily focuses on implementing cutting-edge technical security tools like advanced firewalls and encryption.
   • cIts main purpose is to achieve official certification, which is always cost-effective for any organization.
   • dIt guarantees complete immunity from all future data breaches.
   Show the answer

   Answer: a · It provides a continuous, structured approach to identify and mitigate data security risks.

   The card emphasizes that an ISMS treats security as a "living system" and a "continuous process" for "systematically reducing" risks, making option A the core advantage. Option B is incorrect because the card explicitly states security is "not as a single tool like a firewall" and involves a holistic system of policies, procedures, and technical controls, not just technical tools.

   Read the full bite: Securing Research Data with a Management System

6. Question 6 of 30

   According to the card, in which situation would formulating a formal research hypothesis be LEAST appropriate?

   • aWhen evaluating the impact of a website redesign on user retention.
   • bWhen optimizing the conversion funnel for an e-commerce platform.
   • cWhen performing exploratory research to identify unmet user needs.
   • dWhen conducting an A/B test to compare two versions of a product feature.
   Show the answer

   Answer: c · When performing exploratory research to identify unmet user needs.

   The card states that a formal hypothesis is "less useful during early-stage, exploratory research" because the goal is discovery, not testing pre-formed assumptions. The other options describe evaluative research scenarios where a hypothesis is explicitly recommended for measuring impact.

   Read the full bite: Research Hypothesis: A Testable Bet on Reality

7. Question 7 of 30

   When designing a screener survey, why is it crucial to phrase questions neutrally, without revealing the desired participant profile?

   • aTo avoid biasing participants into providing answers they think the researcher wants to hear.
   • bTo collect a broader spectrum of opinions before narrowing down the participant pool.
   • cTo make the survey accessible to individuals with varying levels of technical expertise.
   • dTo ensure the survey remains concise and does not overwhelm potential participants.
   Show the answer

   Answer: a · To avoid biasing participants into providing answers they think the researcher wants to hear.

   The card explicitly states that neutral questions prevent participants from guessing the 'right' answers, which could bias their responses. While conciseness is good, the primary reason for neutrality is to ensure authentic responses, not just efficiency.

   Read the full bite: Screener Surveys: Your Filter for Valid User Research

8. Question 8 of 30

   When using the framework to select a UX research method, which two primary axes define the research space?

   • aDirect vs. Indirect, and Say vs. Do
   • bAttitudinal vs. Behavioral, and Qualitative vs. Quantitative
   • cExploratory vs. Explanatory, and Observational vs. Experimental
   • dPrimary vs. Secondary, and Formative vs. Summative
   Show the answer

   Answer: b · Attitudinal vs. Behavioral, and Qualitative vs. Quantitative

   The card explicitly defines the two primary axes of the framework as 'Attitudinal vs. Behavioral' and 'Qualitative vs. Quantitative'. While 'Say vs. Do' and 'Direct vs. Indirect' describe aspects of these axes, they are not the formal names of the axes themselves within this framework.

   Read the full bite: How to Choose a UX Research Method

9. Question 9 of 30

   For which scenario would a UX researcher most appropriately choose probability sampling over convenience sampling?

   • aTo recruit participants from an existing user panel to save time and resources.
   • bTo gather rapid feedback for iterating on a design during a formative study.
   • cTo make a high-stakes strategic decision requiring findings generalizable to an entire user base.
   • dTo quickly identify glaring usability problems in a new checkout flow.
   Show the answer

   Answer: c · To make a high-stakes strategic decision requiring findings generalizable to an entire user base.

   Probability sampling is essential for high-stakes strategic decisions where findings must be generalizable to a broader population. Options A, B, and D describe situations where convenience sampling is recommended due to its speed and cost-effectiveness for identifying usability issues or getting quick feedback.

   Read the full bite: UX Sampling: Convenience vs. Probability

10. Question 10 of 30

    What is the primary goal of conducting a pilot study in user research?

    • aTo train new researchers on how to conduct user interviews and observations.
    • bTo identify and correct potential issues within the research study's design and execution.
    • cTo obtain early user insights into the product's design and functionality.
    • dTo determine the optimal number of participants needed for the main research study.
    Show the answer

    Answer: b · To identify and correct potential issues within the research study's design and execution.

    The card explicitly states that a pilot study's goal is to "find and fix problems in the research plan itself" and "debug your methodology," making option B the correct answer. Option C is a common misconception, as the pilot's purpose is not to evaluate the product but the research design.

    Read the full bite: Pilot Studies: A Dress Rehearsal for User Research

11. Question 11 of 30

    A researcher needs to study a population that is difficult to identify and access. Which scenario best illustrates an appropriate use of snowball sampling?

    • aEstimating the prevalence of a common disease across a diverse national population.
    • bAnalyzing the impact of a new educational policy on all public school teachers in a state.
    • cStudying the communication patterns within a clandestine activist group.
    • dSurveying a representative sample of employees in a large corporation about job satisfaction.
    Show the answer

    Answer: c · Studying the communication patterns within a clandestine activist group.

    Snowball sampling is ideal for populations that are hard to reach, hidden, or lack a clear sampling frame, as it leverages existing social networks to gain access. A clandestine group fits this description perfectly, unlike scenarios requiring statistical generalization or having readily available sampling frames.

    Read the full bite: Snowball Sampling: When Your Users Find Your Users

12. Question 12 of 30

    When recruiting from a broad remote-testing panel, which combination of practices best preserves research integrity according to the screening model?

    • aExcluding only professional testers while welcoming UX-adjacent team members
    • bUsing demographic quotas and skipping manual review to reduce researcher workload
    • cAutomating the screener and maximizing the number of accepted participants
    • dFiltering for relevant experience and manually vetting responses for honesty
    Show the answer

    Answer: d · Filtering for relevant experience and manually vetting responses for honesty

    The card emphasizes that screening combines automated filtering for relevant experience with essential manual vetting of open-ended answers to catch low-effort and dishonest respondents. Distractor B is tempting because reducing workload is appealing, but the card warns that skipping manual review lets professional testers and speedrunners slip through and corrupt insights.

    Read the full bite: Screening UX Research Candidates

13. Question 13 of 30

    According to the card, what is the main risk of underpaying participants in UX research?

    • aIt results in a participant pool that does not accurately reflect the target user demographic.
    • bIt leads to higher overall research costs due to repeated recruitment efforts.
    • cIt produces poor data quality and unreliable insights, invalidating the research.
    • dIt attracts participants primarily motivated by the incentive, biasing their feedback.
    Show the answer

    Answer: c · It produces poor data quality and unreliable insights, invalidating the research.

    The card explicitly states that underpaying is a 'footgun' that leads to 'poor data and unreliable insights' and that incentives are an 'investment in data validity.' While an unrepresentative participant pool (Option A) is a consequence of underpaying, it is a mechanism that ultimately leads to the primary risk of poor data quality and invalid research findings.

    Read the full bite: UX Research Incentives: How Much to Pay Participants

14. Question 14 of 30

    For which scenario is open card sorting most appropriate?

    • aAssessing the usability of an existing website's navigation menu.
    • bPrioritizing new features to be added to an application.
    • cDiscovering how users intuitively group content for a new site structure.
    • dDeciding on the visual hierarchy and layout of individual web pages.
    Show the answer

    Answer: c · Discovering how users intuitively group content for a new site structure.

    Open card sorting is specifically designed to uncover users' mental models for organizing information, making it ideal for designing new information architectures. It is not used for evaluating existing site structures, which is better handled by methods like tree testing.

    Read the full bite: Open Card Sorting: Map Your User's Brain

15. Question 15 of 30

    Which statement best describes the core principle distinguishing participatory design from conventional design methods?

    • aIt is a method for accelerating project timelines by allowing users to directly choose preferred features.
    • bIt focuses on creating aesthetically pleasing designs that resonate emotionally with the target audience.
    • cIt primarily aims to validate designer assumptions by collecting user feedback on completed prototypes.
    • dIt treats end-users as active partners, sharing decision-making power and integrating their lived experience as expertise.
    Show the answer

    Answer: d · It treats end-users as active partners, sharing decision-making power and integrating their lived experience as expertise.

    Participatory design's core principle is to involve users as active co-creators and partners, valuing their lived experience as expertise and sharing decision-making power. Option C describes a common practice in traditional design, where feedback is sought on already developed solutions, rather than involving users in the creation process from the start.

    Read the full bite: Participatory Design: Designing With, Not For, Users

16. Question 16 of 30

    For which scenario is First Click Testing LEAST suitable?

    • aValidating the intuitive placement of a "Sign Up" button on a landing page.
    • bComparing two proposed designs for a website's primary navigation.
    • cTesting if users can locate the return policy link on an e-commerce product page.
    • dEvaluating the overall flow and potential drop-off points in a 5-step registration form.
    Show the answer

    Answer: d · Evaluating the overall flow and potential drop-off points in a 5-step registration form.

    First Click Testing is specifically designed to evaluate only the very first step of a user's journey, making it unsuitable for assessing multi-step processes or entire user flows. It excels at validating initial navigation and single-click clarity, as described in the other options.

    Read the full bite: First Click Testing: Predicting Task Success with One Click

17. Question 17 of 30

    When is tree testing most appropriately utilized in the product development lifecycle?

    • aAfter a website has been launched to identify and fix existing navigation issues in a live environment.
    • bTo evaluate the findability of a proposed navigation structure before any visual design is implemented.
    • cTo conduct a comprehensive usability test on a fully interactive prototype, including visual elements and content.
    • dAs the initial technique to generate a new site's information architecture from user input.
    Show the answer

    Answer: b · To evaluate the findability of a proposed navigation structure before any visual design is implemented.

    Tree testing is specifically designed to validate a proposed information architecture in a text-only format before any UI is built, focusing purely on the findability of the structure. Option D describes card sorting, which is used to generate an IA, not validate it, and Option C describes a full usability test, which includes visual and interactive elements that tree testing deliberately excludes.

    Read the full bite: Tree Testing: Validate Your Site's Navigation Structure

18. Question 18 of 30

    Which scenario best illustrates the appropriate application of a cognitive walkthrough?

    • aA team needs to identify all potential usability issues across an entire complex software suite before its final release.
    • bDesigners are evaluating a wireframe of a new user registration flow to ensure a first-time user can easily complete it.
    • cResearchers want to observe how real users interact with a fully functional prototype to uncover unexpected behaviors.
    • dA product manager is assessing whether the user interface adheres to established usability principles and guidelines.
    Show the answer

    Answer: b · Designers are evaluating a wireframe of a new user registration flow to ensure a first-time user can easily complete it.

    Option B accurately describes using a cognitive walkthrough for a specific task (registration flow) for a new user at an early design stage (wireframe), which is its intended purpose. Option A describes a holistic review, which is explicitly stated as not suitable for a cognitive walkthrough; that would be a heuristic evaluation.

    Read the full bite: Cognitive Walkthrough: See Through a New User's Eyes

19. Question 19 of 30

    If an A/B test for a new website feature yields a p-value of 0.02, what is the most accurate interpretation?

    • aThere is a 98% probability that the new feature caused the observed difference.
    • bThere is a 2% chance of observing results as extreme as these, assuming the new feature has no actual effect.
    • cThe probability that the null hypothesis is true is 0.02.
    • dThe new feature is guaranteed to be more effective than the old one.
    Show the answer

    Answer: b · There is a 2% chance of observing results as extreme as these, assuming the new feature has no actual effect.

    A p-value indicates the probability of seeing your results by chance, assuming the null hypothesis (no effect) is true. It does not state the probability of the null hypothesis being true, nor does it guarantee the alternative hypothesis.

    Read the full bite: P-Value: Gauging Surprise, Not Certainty

20. Question 20 of 30

    Which statement best describes the unique focus of Customer Effort Score (CES) compared to other customer metrics?

    • aIt quantifies the overall satisfaction a customer has with a brand.
    • bIt assesses the ease or difficulty a customer experiences completing a specific task.
    • cIt tracks long-term customer loyalty and retention rates.
    • dIt measures a customer's likelihood to recommend a product or service.
    Show the answer

    Answer: b · It assesses the ease or difficulty a customer experiences completing a specific task.

    CES is designed to measure the effort a customer expends on a specific, transactional task, acting as a 'friction meter' for that interaction. Unlike metrics such as Net Promoter Score (NPS) or Customer Satisfaction (CSAT), which gauge overall loyalty or general satisfaction, CES pinpoints friction in a particular process.

    Read the full bite: Customer Effort Score (CES): Measure Task Friction

21. Question 21 of 30

    Which data collection method is least susceptible to the effects of response bias?

    • aAnalyzing server logs to track user click-through rates on a new feature
    • bA survey asking users about their daily screen time habits
    • cInterviewing customers to understand their motivations for purchasing a specific product
    • dConducting a focus group to gather opinions on a product's ease of use
    Show the answer

    Answer: a · Analyzing server logs to track user click-through rates on a new feature

    The card states that response bias is less relevant for "purely behavioral or system-level data" like "server logs of user clicks," as these are objective records of actions. The other options involve self-reported data, which is directly prone to various human biases.

    Read the full bite: Survey Response Bias: When Answers Mislead

22. Question 22 of 30

    Which critical insight will clickstream analysis *not* directly provide?

    • aThe effectiveness of an A/B test variant in guiding users to conversion.
    • bThe specific sequence of pages a user visited before abandoning a cart.
    • cThe emotional state or frustration level of a user at a particular step.
    • dThe exact point in a checkout flow where most users encounter friction.
    Show the answer

    Answer: c · The emotional state or frustration level of a user at a particular step.

    Clickstream analysis excels at showing *what* users did and *where* they encountered issues, but it explicitly states it does not show *why* they did it or their underlying motivations or emotional states. To understand 'why,' qualitative data is needed.

    Read the full bite: Clickstream Analysis: Following the User's Footsteps

23. Question 23 of 30

    A researcher wants to know why a company's ad tone shifted in 2020 and has only the existing ads. What limitation does content analysis face here?

    • aIt introduces researcher interference by exposing the team to the coding process
    • bIt sacrifices replicability because each ad requires a unique coding approach
    • cIt limits analysis to written text and cannot examine video or audio advertisements
    • dIt can identify patterns in the ads but cannot explain the team's motivations behind the shift
    Show the answer

    Answer: d · It can identify patterns in the ads but cannot explain the team's motivations behind the shift

    Content analysis extracts patterns from existing artifacts but cannot ask creators why they made specific choices. Option C is tempting because of the common misconception that the method is writing-only, yet the card explicitly includes visual and spoken media.

    Read the full bite: Content Analysis: Study Texts Without Interference

24. Question 24 of 30

    After user research, a team prepares insight statements for the define stage. Which approach best aligns with their purpose?

    • aReframing 'needs a dashboard' into 'needs to monitor trends' before brainstorming
    • bDrafting statements that specify UI components to reduce ambiguity for developers
    • cFinalizing statements as sprint requirements to hand off to engineers
    • dPrioritizing needs by technical feasibility to narrow scope before ideation
    Show the answer

    Answer: a · Reframing 'needs a dashboard' into 'needs to monitor trends' before brainstorming

    Insight statements deliberately frame needs as verbs (monitor) rather than solutions (dashboard) to keep the design space open before ideation. Option B incorrectly inserts solutions, while D confuses the statement with a delivery artifact.

    Read the full bite: Insight Statements: Frame Problems, Not Solutions

25. Question 25 of 30

    In a mental model diagram, one cluster of user behaviors in the top half has no product features aligned beneath it, while elsewhere a feature sits below the line with no behavior above it. What do these two situations respectively reveal?

    • aThe first is an opportunity gap, a real need nothing is built for; the second is a feature that may be waste, since no observed behavior supports it
    • bThe first indicates a data collection error requiring re-interviews; the second indicates the feature just needs better marketing copy
    • cThe first means the feature is hidden in a nested tower and just needs relocating; the second means the behavior was mislabeled
    • dBoth situations only mean the interview sample size was too small to draw any real conclusion
    Show the answer

    Answer: a · The first is an opportunity gap, a real need nothing is built for; the second is a feature that may be waste, since no observed behavior supports it

    An unsupported behavior cluster is an opportunity gap, a real need with nothing built for it, while a feature with no behavior above it is a candidate for cutting since no observed need supports it. Neither gap is about sample size or mislabeling, they are exactly the alignment gaps the diagram exists to expose.

    Read the full bite: Mental Model Diagram

26. Question 26 of 30

    A researcher analyzes a patient's journals and interviews to understand their illness experience. What is the primary analytic focus in narrative analysis?

    • aChecking dates and facts against medical records for accuracy
    • bExamining how the patient sequences events and constructs meaning across texts
    • cCounting mentions of specific emotions to score distress levels
    • dSelecting quotes that illustrate a pre-existing theory of trauma
    Show the answer

    Answer: b · Examining how the patient sequences events and constructs meaning across texts

    Narrative analysis preserves the whole narrative to study how the teller frames cause, effect, and meaning through structure and sequence. Selecting isolated quotes to support a pre-existing theory is a misuse of the method because it strips away the contextual narrative that gives those details significance.

    Read the full bite: Narrative Analysis: How People Build Meaning

27. Question 27 of 30

    A researcher finds that 60% of 200 randomly sampled users prefer a new design. What does inferential statistics correctly allow her to conclude?

    • aThat the sample is only a shadow of the population and therefore cannot support any claims about all users
    • bThat the true preference rate across the entire user base is likely close to 60% but carries uncertainty
    • cThat she should treat the 60% figure as census data since 200 users is a sufficiently large sample
    • dThat exactly 60% of all users prefer the new design because random samples mirror the population perfectly
    Show the answer

    Answer: b · That the true preference rate across the entire user base is likely close to 60% but carries uncertainty

    The card emphasizes that inferential statistics yields population estimates with structured uncertainty rather than declaring the sample statistic as exact truth. Option D exemplifies the exact footgun warned against: forgetting your data is just a sample and declaring truth about all users.

    Read the full bite: Inferential Statistics: From Sample to Population

28. Question 28 of 30

    When should you choose a t-test over a Z-test to compare two group means?

    • aWhen the two groups have markedly different variances or non-normal shapes
    • bWhen the population standard deviation is unknown and must be estimated from the sample
    • cWhen the total sample size across both groups is smaller than 30
    • dWhen you want the exact probability that the null hypothesis is true
    Show the answer

    Answer: b · When the population standard deviation is unknown and must be estimated from the sample

    The t-test is designed for cases where the population standard deviation is unknown and estimated from the sample, while a Z-test requires it to be known beforehand. Option C is tempting but wrong because the choice depends on whether the standard deviation is known, not on an arbitrary sample-size cutoff.

    Read the full bite: T-test: Are Two Groups Actually Different?

29. Question 29 of 30

    After discovering that patients often forget to take their medication on schedule, which HMW question best follows the card's guidance?

    • aHow might we increase patient adherence through better schedule management?
    • bHow might we help patients feel in control of their daily medication routines?
    • cHow might we send patients automated reminders to take their medication?
    • dHow might we improve the overall medication experience for patients?
    Show the answer

    Answer: b · How might we help patients feel in control of their daily medication routines?

    The correct answer removes any embedded solution and reframes the insight around the user's sense of control, which opens the door to unexpected ideas while staying anchored to the research. Option C is tempting but limits ideation to notification tactics by baking a specific feature into the question.

    Read the full bite: HMW Questions: From Research Insights to Design Ideas

30. Question 30 of 30

    When presenting qualitative research to executives, what makes a highlight reel more effective than a summary of charts and quotes?

    • aIt should be polished like a marketing video to ensure stakeholders watch it to the end
    • bIt provides statistical proof of how widespread an issue is across the user base
    • cIt preserves the emotional nuance of users struggling in their own words to drive empathy
    • dIt allows the team to replace the full research repository and quantitative analysis
    Show the answer

    Answer: c · It preserves the emotional nuance of users struggling in their own words to drive empathy

    The card states that highlight reels preserve original emotion and nuance that summaries lose, creating empathy and memorable evidence. Distractor A is tempting but wrong because the card explicitly warns that a reel cannot show prevalence across the entire user base.

    Read the full bite: UX Highlight Reels: Show, Don't Tell