Design a cashierless retail checkout vision system.
end-to-end CV system design.
multi-camera coverage, person tracking and re-ID, product detection plus action recognition for take or return, sensor fusion, edge-cloud split, and failure handling.
What's really being asked
The interviewer evaluates whether you can architect a complete multi-component vision system, reason about deployment, and plan for the messy real world rather than naming one model.
The full answer
Camera layout: overhead cameras for tracking people across the floor plus shelf-facing cameras for fine product interaction, arranged for overlapping coverage to reduce blind spots. Core vision tasks: person detection and multi-object tracking, with person re-identification to maintain identity across cameras and time; product detection and classification on shelves; action or hand-interaction recognition to decide whether an item was taken or returned; and association logic linking each item event to the correct shopper's virtual cart. Sensor fusion: combine vision with shelf weight sensors or RFID to disambiguate hard cases. Deployment: run latency-sensitive detection and tracking on edge devices near the cameras for real-time response and bandwidth savings, while heavier re-ID matching and analytics can run in the cloud; balance latency, bandwidth, cost, and privacy. Failure modes: occlusion and crowding, identity swaps during close contact, look-alike products, and ambiguous take-or-return; mitigate with multi-view redundancy, sensor fusion, confidence thresholds, and routing low-confidence events to human review or receipt correction.
The mistakes people make
Proposing one detector and calling it done. Ignoring person tracking and item-to-person association. No fusion, no failure handling, no edge-versus-cloud reasoning.
What usually comes next
Handling re-ID under similar clothing, the privacy and data-retention implications, latency budgets, and how to bootstrap training data.
A concrete example
In a Just Walk Out style store, overhead cameras track each shopper, shelf cameras plus weight sensors detect a can being picked up, action recognition confirms a take rather than a return, association adds it to that person's cart, and an ambiguous double-grab is flagged for review so the final receipt stays correct.
Interview question
Why is multi-camera person re-identification essential in a cashierless checkout system?
- a.To reduce the number of cameras needed in the store
- b.To keep each shopper's identity consistent so items are billed to the right personCorrect
- c.To replace the need for product detection
- d.To compress video before cloud upload
Why? this is the answer
Re-ID maintains a shopper's identity across cameras and time so picked items map to the correct virtual cart. It does not reduce camera count, replace product detection, or handle video compression.
Just read this? Test yourself on what you have been reading.
Read the original → en.wikipedia.org
- #system-design
- #cashierless
- #person-reid
- #object-detection
- #edge-cloud
Put your scrolling time to good use
Learn one idea, try a quiz and save useful cards for revision. Tezvyn makes it easy to learn and stay current in your tech field, a few minutes at a time.
The iPhone app is on the way
We are building it. Until it lands, nothing here is held back from you: every interview card, your saved cards, streaks and the job board all work in Safari, plus hundreds of free practice quizzes of thirty questions each. Sign in and it all carries over to the app the day it arrives.
Want it as an icon? Tap Share at the bottom of Safari, then Add to Home Screen. It opens full screen and the cards you have read stay available offline.
We are hiring for this. Open roles that interview on system-design — each one lists the topics its interview covers.
See open roles