Skip to content
tezvyn:

Why was this customer denied: global or local explanation?

Source: christophm.github.ioEasyHow cards are made

Why was this customer denied: global or local explanation?

This tests matching questions to explanation scope. Global methods show overall behavior; local methods explain one prediction. Specific denials need local methods like SHAP. A red flag is using global summaries like permutation importance or PDPs for a case.

What's really being asked

Whether you can match the scope of an explanation to a business question and name practical tooling. A product manager asking about one customer is asking a local question, but many engineers default to global model summaries because those are the metrics they monitor in training pipelines. The interviewer wants to see that you understand the difference between how a model behaves in general and why it made one specific decision.

The full answer

First, define global explanations as methods that describe overall model behavior across the dataset, such as permutation feature importance, partial dependence plots, or accumulated local effects. Second, define local explanations as methods that unpack exactly one prediction, such as SHAP values, LIME, or counterfactual explanations. Third, state clearly that a question about a specific loan denial requires a local explanation because global trends can average away the unique feature combination that triggered this denial. Fourth, name a concrete library like the Python shap package, lime, or alibi and briefly note what it produces, for example SHAP force plots or waterfall charts that show directional feature contributions for a single row.

The mistakes people make

Confusing global and local scope is the biggest red flag. Do not suggest permutation feature importance or PDPs to explain one person. Another red flag is giving a vague answer like we look at the weights without specifying whether you mean global coefficients or local attribution values. Also avoid saying you would just show the feature values; the PM already knows the customer has a low credit score, they want to know how much that mattered relative to other features for this exact prediction.

What usually comes next

The interviewer might ask how you would explain SHAP values to a non-technical PM without jargon. They might ask what you would do if the local explanation contradicts the global story, for example if a feature usually helps approval but hurt this customer. They might also ask how you handle correlated features in local explanations, or when global explanations are actually the right tool, such as during model validation or regulatory reporting.

A concrete example

Suppose a customer with a 720 credit score and a debt-to-income ratio of 48 percent is denied. A global PDP might show that higher DTI generally increases denial probability across the portfolio. But the local SHAP explanation reveals that for this exact customer, the DTI contributed plus 0.15 toward denial while the credit score contributed minus 0.08 toward approval, and the model threshold was 0.10. That precise breakdown lets the PM understand why the denial happened and what the customer could change.

Interview question

A product manager asks why one specific customer was denied a loan. Which method best explains the model's reasoning for that individual case?

  • a.Partial dependence plot showing the average effect of debt-to-income ratio
  • b.Permutation feature importance ranked across the entire training set
  • c.SHAP values showing directional feature contributions for this specific applicationCorrect
  • d.The coefficient weights learned by the model during training
Why?

A question about one denial is a local explanation problem, and SHAP values unpack exactly how each feature contributed to that single prediction. Permutation feature importance is a global summary of overall model behavior and cannot reveal the unique feature combination that triggered this specific denial.

Just read this? Test yourself on what you have been reading.

Read the original → christophm.github.io

You just looked this up. Could you explain it out loud?

That is the part interviews actually test. Tezvyn takes questions like this one and gives you what the interviewer is really checking, the answer that lands, and the mistake that ends the conversation, in the four minutes before your next meeting.

The iPhone app is on the way

We are building it. Until it lands, nothing here is held back from you: every interview card, your saved cards, streaks and the job board all work in Safari, plus hundreds of free practice quizzes of thirty questions each. Sign in and it all carries over to the app the day it arrives.

Want it as an icon? Tap Share at the bottom of Safari, then Add to Home Screen. It opens full screen and the cards you have read stay available offline.

Get it on Google PlayiPhone app coming soon

We are hiring for this. Every open role lists the topics its interview covers, so you can prepare for the real thing rather than guessing.

See open roles