Recruiting channels for a B2C usability study
Awareness of recruiting trade-offs.
Compare panels for speed versus in-product intercepts for authenticity, weigh cost, screening rigor, and bias.
What's really being asked
The interviewer checks whether you grasp that how you recruit determines whose behavior you observe, and therefore how trustworthy your findings are. It tests practical judgment about cost, speed, and bias rather than rote method knowledge.
The full answer
Name two contrasting channels and compare them on the three axes. A paid research panel or recruiting agency is fast, often delivering participants in days, and lets you specify demographics through screeners. The downside is cost per participant and the risk of professional testers who behave unnaturally, plus weaker fit to your actual audience. An in-product intercept, such as a banner inviting real current users, gives high-quality, representative participants who genuinely use the product, often at low marginal cost. The trade-off is slower fill rates, dependence on traffic, and a skew toward already-engaged users, missing churned or new ones. Mention screener questions and incentives as quality levers in both cases.
The mistakes people make
Naming a single channel with no comparison. Treating cost as the only axis. Ignoring sampling bias, especially that panels attract repeat testers and intercepts miss non-users. Assuming more participants always means better data for a qualitative usability study.
What usually comes next
How many participants do you need for a usability test. How do you write a screener that filters out professional testers. How would recruiting differ for a niche B2B audience.
A concrete example
For a consumer budgeting app, you intercept active users in-product to study a new transaction view, getting authentic behavior cheaply but slowly. To also reach people who abandoned the app, you use a panel with a screener targeting lapsed budgeting-app users, accepting higher cost for speed and reach. Combining both balances representativeness against timeline, and you weight findings knowing the panel may include less typical participants.
Interview question
Why might an in-product intercept yield higher-quality usability data than a paid panel, despite being slower?
- a.Participants are real, representative users behaving naturally rather than professional testersCorrect
- b.Panels cannot use screener questions to filter participants
- c.Intercepts guarantee a perfectly balanced demographic sample
- d.Intercepts are always cheaper than any panel
Why? this is the answer
In-product intercepts capture genuine current users acting naturally, while panels risk professional testers; the other options overstate cost, balance, and screening claims.
Just read this? Test yourself on what you have been reading.
- #ux-research
- #recruiting
- #usability-testing
- #sampling-bias
- #trade-offs
Put your scrolling time to good use
Learn one idea, try a quiz and save useful cards for revision. Tezvyn makes it easy to learn and stay current in your tech field, a few minutes at a time.
The iPhone app is on the way
We are building it. Until it lands, nothing here is held back from you: every interview card, your saved cards, streaks and the job board all work in Safari, plus hundreds of free practice quizzes of thirty questions each. Sign in and it all carries over to the app the day it arrives.
Want it as an icon? Tap Share at the bottom of Safari, then Add to Home Screen. It opens full screen and the cards you have read stay available offline.
We are hiring for this. Open roles that interview on ux-research — each one lists the topics its interview covers.
See open roles