What two techniques mitigate professional-tester bias in screener design?
WHAT IT TESTS: Using behavioral questions and exclusion criteria to stop professional panelists. ANSWER OUTLINE: Swap guessable questions for behavioral ones about real tasks, and add exclusion criteria to block web-savvy professional testers.
WHAT IT TESTS: Your ability to reduce recruitment bias by designing screeners that filter out professional testers who game knowledge-based questions. ANSWER OUTLINE: First, reframe screening around behavioral characteristics by asking what target users actually do rather than using guessable knowledge or demographic questions; second, define explicit exclusion criteria that disqualify web-savvy IT professionals and habitual research-panel members who skew data.
Read the original → nngroup.com
- #ux research
- #screener design
- #recruitment bias
- #user research
- #participant screening
Get five bites like this every day.
Tezvyn delivers a daily feed of 60-second tech bites with quizzes to lock in what you learn.