How a single set of data can tell two opposite stories
In short: Imagine looking at a dataset that proves one conclusion, only to find that when you group the same numbers differently, they prove the exact opposite. This isn't a glitch in the math; it is Simpson's Paradox, a statistical phenomenon where hidden variables can flip the reality of your results.
Simpson's Paradox occurs when the marginal association between two categorical variables differs qualitatively from the partial association once you control for a third variable. In simpler terms, looking at a large group can mask trends that are actually happening within smaller subgroups. This happens because the relationship between variables is not immutable; it can increase, decrease, or even completely reverse direction depending on which factors are being controlled.
To see this in action, consider a university investigating potential sex bias in graduate admissions. At first glance, the aggregate data might suggest a bias against women: if 40 percent of men were admitted compared to only 25 percent of women, it appears clear that men have an advantage. However, when the university subdivides the applicants by department—natural sciences versus social sciences—the trend reverses entirely.
In natural sciences, women had an 80 percent admission rate compared to 46 percent for men. In social sciences, women were admitted at a rate of 20 percent, while men were only admitted at 4 percent. This paradox serves as a critical warning for researchers and decision-makers. It highlights the danger of making causal inferences from nonexperimental studies without identifying uncontrolled or unobserved variables. Because combining groups can lead to surprising or reversed results, statisticians must be careful to recognize when an aggregate trend is being driven by hidden underlying structures rather than a direct relationship between the primary subjects.
Opens the Intellect+ feed with this card first. Swipe up for the next one.
Sources
- Summary by Intellect · source: Simpson's Paradox
- Also: Simpson’s paradox | Definition, Example, and Explanation | Britannica
To cite this card, link to https://intellectplus.co.uk/app/space-simpson-s-paradox.
How we source, check and correct cards: Editorial standards.
General information, not professional advice. Spotted an error? Flag the card or see corrections and complaints.
Intellect Plus is a visual educational discovery platform for exploring fascinating facts and ideas. Brain Food, Not Brain Rot. What is Intellect Plus?
Related
More in Space · Latest · A–Z · All topics