tezvyn:

Correlation Does Not Mean Causation

AI-drafted, machine-checkedSource: Wikipedia: Correlation does not imply causationbeginner

Two metrics moving together does not mean one drives the other. In UX research, a spike in clicks after a redesign does not prove the redesign caused it. The footgun is treating every coincidence as proof your change worked.

WHY IT EXISTS: Humans are pattern-seeking animals. When two things happen together, our brains automatically weave a story of cause and effect because that narrative feels safer and more predictable than randomness. The concept exists as a guardrail against that instinct, forcing evidence before we act on a relationship between variables.

THE MENTAL MODEL: Think of correlation as a neighborhood watch report and causation as a conviction in court. The witness saw two people near the scene at the same time, but that alone does not prove either person committed the crime. You need motive, opportunity, and a mechanism before you can sentence someone; likewise, you need a controlled mechanism before you can claim one metric drives another.

HOW IT WORKS: Correlation measures statistical association, usually expressed as a coefficient between negative one and positive one. Causation requires three harder conditions: the cause must precede the effect, the two must covary, and every alternative explanation must be ruled out. In practice, that means running randomized controlled experiments, using instrumental variables, or applying causal inference frameworks rather than simply eyeballing a dashboard trend.

WHEN TO USE IT: Use this distinction when interpreting analytics, A/B test results, survey cross-tabs, or ethnographic observations. Any time a stakeholder says we changed X and Y went up, so X caused Y, pause and map whether a hidden variable Z could explain both. It is especially vital during quarterly reviews when teams mine historical data for success stories without experimental controls.

WHEN NOT TO USE IT: Do not invoke the phrase to dismiss every observed relationship as meaningless. Correlation is still a powerful signal for generating hypotheses and deciding where to invest experimental bandwidth. The error is stopping at correlation, not starting there.

ONE CANONICAL EXAMPLE: Ice cream sales and drowning deaths both spike in summer. Banning ice cream would not reduce drowning; the hidden variable is hot weather. In UX, a similar trap occurs when mobile app crashes and five-star reviews both rise after a release. The crashes did not cause the praise; a simultaneous marketing push attracted new users who rated the app before hitting the bug.

Read the original → en.wikipedia.org

Get five bites like this every day.

Tezvyn delivers a daily feed of 60-second tech bites with quizzes to lock in what you learn.