Skip to content
tezvyn:

What instrumentation would you add to validate the user's 'job'?

Source: christenseninstitute.orgMediumHow cards are made

What instrumentation would you add to validate the user's 'job'?

This tests whether you instrument for intent and struggle, not vanity metrics. Strong answers log pre-export context, abandonment flows, post-export file usage, and workaround signals.

What's really being asked

This question tests whether you understand that Jobs to Be Done is about the progress a user is trying to make in specific circumstances, not about feature popularity or user demographics. The interviewer wants to see if you can design telemetry that captures intent, struggle, and context at scale. Engineers often instrument for vanity metrics like button clicks; this probes whether you can build logging that reveals the functional, social, and emotional forces that pull users toward or push them away from using the export.

The full answer

A strong answer proposes event logging that maps to the full job timeline. First, capture pre-export context: what queries, filters, or date ranges led the user to the export button, because the job often begins before the feature is touched. Second, instrument the export flow itself with step-level abandonment tracking to identify where anxiety or confusion blocks progress. Third, log post-export behavior: whether the file is downloaded, opened, shared, or re-imported elsewhere, since the job is not done when the file leaves the system. Fourth, detect workarounds like copy-pasting data, printing to PDF, or taking screenshots, which reveal the real job users are hiring the product to do when the official feature fails them. Fifth, add lightweight qualitative signals such as rage clicks, long pauses, or help-menu searches during the export workflow.

The mistakes people make

Red flags include proposing only aggregate usage counts or demographic segmentation, which the Christensen Institute explicitly contrasts with Jobs Theory. Another mistake is suggesting an exit survey without any behavioral instrumentation, since that relies on recall rather than observed behavior. Proposing to track only successful exports misses the struggling moments where the real job insight lives. Similarly, suggesting A/B tests of button colors or tooltip copy before understanding the underlying progress the user seeks puts tactics ahead of diagnosis.

What usually comes next

The interviewer may ask how you would prioritize these instrumentation points given engineering constraints, or how you would distinguish between a user who exported data for compliance versus analysis without asking them directly. They might also probe how you would validate that a detected workaround actually maps to the same job, or how you would instrument for social and emotional forces like the need to look competent when sharing a report with leadership.

A concrete example

Suppose users frequently apply a complex filter, reach the export preview, and then abandon the flow. Instrumentation shows they immediately open a spreadsheet tool and paste data manually. The hypothesis is that their job is not to own a CSV file but to answer a specific question before a meeting. To test this, you instrument for preview-stage behavior, track whether exported files are ever opened, and detect manual copy events. If the data shows preview abandonment correlates with same-day manual spreadsheet work, you have evidence the job is rapid insight, not file ownership.

Interview question

Which mix of telemetry best reveals the user's true job-to-be-done during data export?

  • a.Log step-level abandonment in the export flow, post-export file usage, pre-export context like filters, and detect workarounds such as copy-pasting.Correct
  • b.Track total export button clicks, successful export counts, and user demographic segments to correlate usage with persona.
  • c.Deploy an exit survey after every export asking users why they exported, and track only completed exports as success signals.
  • d.Run A/B tests on export button color and tooltip copy while tracking aggregate conversion rates to optimize the funnel.
Why?

The correct answer maps instrumentation to the full job timeline—intent, struggle, and context—rather than just feature usage. The exit-survey option is tempting but relies on recall instead of observed behavior, missing the critical struggling moments where the real job insight lives.

Just read this? Test yourself on what you have been reading.

Read the original → christenseninstitute.org

You just looked this up. Could you explain it out loud?

That is the part interviews actually test. Tezvyn takes questions like this one and gives you what the interviewer is really checking, the answer that lands, and the mistake that ends the conversation, in the four minutes before your next meeting.

The iPhone app is on the way

We are building it. Until it lands, nothing here is held back from you: every interview card, your saved cards, streaks and the job board all work in Safari, plus hundreds of free practice quizzes of thirty questions each. Sign in and it all carries over to the app the day it arrives.

Want it as an icon? Tap Share at the bottom of Safari, then Add to Home Screen. It opens full screen and the cards you have read stay available offline.

Get it on Google PlayiPhone app coming soon

We are hiring for this. Every open role lists the topics its interview covers, so you can prepare for the real thing rather than guessing.

See open roles