Propose a strategy for finding and vetting low-incidence participants

WHAT THIS TESTS: This question evaluates whether you can construct a recruitment and vetting pipeline for a population that is too rare for standard panels. It specifically probes your knowledge of non-probability sampling methods, your awareness of external validity threats like professional testers and convenience-sample bias, and your ability to design screeners that verify behavioral criteria rather than superficial self-identification.

A GOOD ANSWER COVERS: A good answer hits four things in order. First, diversify sourcing channels by going where the users already congregate, such as specialized subreddits, LinkedIn groups for that industrial software, trade associations, colorblind advocacy forums, and left-handed product communities. Second, use snowball sampling by asking each qualified participant to refer one or two peers, since low-incidence traits cluster in professional and social networks. Third, build a multi-layer screener that asks behavioral questions to confirm all three criteria, such as requesting the candidate's most-used software module or describing how they adapt interfaces for color vision deficiency. Fourth, add anti-fraud and quality checks, like an attention-check question or a request for a redacted screenshot of their workspace, to catch professional testers who know how to game surveys.

COMMON WRONG ANSWERS: The biggest red flag is proposing to solve the problem by simply increasing the sample size or incentive on a generic consumer panel. Another major error is relying on convenience samples like coworkers or personal contacts, which introduces bias because those participants may be too familiar with your organization or reluctant to give negative feedback. A third warning sign is ignoring the need to screen out UX professionals or adjacent experts, who will provide expert reviews rather than realistic user behavior. Finally, suggesting you relax the left-handed or colorblind criteria to speed up recruitment shows you do not understand the study's validity requirements.

LIKELY FOLLOW-UPS: An interviewer may ask how you would handle a high no-show rate when the pool is tiny, or how you would verify colorblindness without requesting medical documentation. They may also probe whether you would lower the incentive if the budget is fixed, or how you would document a decision to relax criteria due to timeline pressure. Another common follow-up is asking how you would weight or balance the sample if you find plenty of colorblind users but very few who also use the niche software.

ONE CONCRETE EXAMPLE: Imagine you need ten participants who are left-handed, deuteranopic, and daily users of Autodesk Vault. You would post in the Vault user forums, the r/ColorBlind subreddit, and left-handed ergonomic equipment groups, offering a two-hundred-dollar honorarium. Your screener would ask candidates to name their most frequent Vault workflow, describe the last time color confusion caused an error at work, and upload a photo of their left-handed mouse setup. You would then conduct a five-minute phone screen with the top fifteen candidates to confirm authenticity before scheduling sessions.

Source: nngroup.com