Screener Surveys: Your Filter for Valid User Research
A screener survey is your filter for finding the right research participants. It ensures your study includes representative users, not just anyone, by asking questions about their behaviors and demographics.
Why it exists
User research is only effective if you talk to the right people. Without a filter, you might test a complex mortgage app with someone who has never had a loan, or an expert tool with a novice. This yields irrelevant data, wastes time and money, and can lead you to build the wrong product based on feedback from the wrong audience.
The mental model
Think of a screener as a bouncer for your research study. Its job isn't to let everyone in, but to check IDs and ensure only people who match the profile you need get through. It filters out individuals who don't fit the behavioral and demographic characteristics of your actual target users, protecting the integrity of your study.
How it works
First, you define your inclusion and exclusion criteria. Inclusion criteria are the factors that make someone a good fit (e.g., "has used a food delivery app in the last month"). Exclusion criteria are disqualifiers (e.g., "works for a competitor"). You then write a short questionnaire to identify these traits without giving away the "right" answers. This ensures you recruit the people you need, not just people who want the incentive.
When to use it
Use a screener before any user research—usability tests, interviews, diary studies—where participant characteristics are critical to getting valid feedback. It ensures participants have the right context, experience, or needs to provide meaningful insights. It also helps filter out participants who are overly familiar with testing or provide low-quality, one-word answers.
When not to use it
It is almost never appropriate to conduct testing with "just anyone" and skip screening entirely. However, the complexity of the screener can vary. For a very broad, general-purpose product, your criteria might be loose. Even then, a light screener is valuable for weeding out participants who are a poor fit or will not provide quality data.
One canonical example
To recruit for a study on a new mortgage-lending app, a bad approach is asking, "Do you want to test our mortgage app?" A good screener would instead ask neutral questions like, "When was the last time you applied for a home loan?" with options like "In the last 6 months," "1-2 years ago," or "Never." This helps you find recent, relevant participants without revealing that you're only looking for them, which could bias their answers.
Interview question
When designing a screener survey, why is it crucial to phrase questions neutrally, without revealing the desired participant profile?
- a.To avoid biasing participants into providing answers they think the researcher wants to hear.Correct
- b.To collect a broader spectrum of opinions before narrowing down the participant pool.
- c.To make the survey accessible to individuals with varying levels of technical expertise.
- d.To ensure the survey remains concise and does not overwhelm potential participants.
Why? this is the answer
The card explicitly states that neutral questions prevent participants from guessing the 'right' answers, which could bias their responses. While conciseness is good, the primary reason for neutrality is to ensure authentic responses, not just efficiency.
Just read this? Test yourself on what you have been reading.
Read the original → nngroup.com
- #ux research
- #user testing
- #recruiting
- #bias
You just looked this up. Could you explain it out loud?
That is the part interviews actually test. Tezvyn takes questions like this one and gives you what the interviewer is really checking, the answer that lands, and the mistake that ends the conversation, in the four minutes before your next meeting.
The iPhone app is on the way
We are building it. Until it lands, nothing here is held back from you: every interview card, your saved cards, streaks and the job board all work in Safari, plus hundreds of free practice quizzes of thirty questions each. Sign in and it all carries over to the app the day it arrives.
Want it as an icon? Tap Share at the bottom of Safari, then Add to Home Screen. It opens full screen and the cards you have read stay available offline.
We are hiring for this. Open roles that interview on ux research — each one lists the topics its interview covers.
See open roles