Survivorship Bias: The Missing Bullet Holes
Abraham Wald, WWII Bombers, and the Data You Never See — A TLDR Primer
Your stats teacher mentions 'survivorship bias' and moves on, but you're stuck wondering why a WWII bomber story matters for your exam — or why every business book quotes the same handful of billionaire dropouts. This primer clears that up, fast.
Survivorship bias explained simply means understanding that the data you see has already been filtered — the failures vanished before anyone counted them. This guide anchors the idea in the real case that made it famous: Abraham Wald and the Statistical Research Group, asked in WWII to figure out where to armor bombers based on bullet holes in planes that came home. The obvious answer was wrong, and why it was wrong is one of the cleanest lessons in statistical reasoning you'll ever encounter.
From there the book walks through the actual math — conditional probability, real world example after example — showing exactly how P(hit given survived) misleads you, then carries the idea into places you'll actually run into it: mutual fund performance claims, 'successful founder' advice, old buildings that 'don't make them like they used to,' and any dataset built from what's left rather than what started.
It closes with a practical checklist for spotting filtered data before you trust it, and ties the concept to media literacy and decision-making you'll meet again in economics, psychology, and history classes.
No filler, no textbook detours — just the concept, the math, and the examples you need to actually get it. Read it before your next stats unit or the next time someone hands you a 'here's what winners do' article.
- Define survivorship bias and identify it as a form of selection bias
- Reconstruct Abraham Wald's reasoning about armoring WWII bombers
- Recognize survivorship bias in mutual fund returns, startup advice, and historical buildings
- Distinguish between the sample you observe and the sample you wanted to observe
- Apply simple conditional-probability thinking to spot filtered data
- Design questions that surface the missing data before making a decision
- 1. The Sample You Can See vs. the Sample You WantedIntroduces survivorship bias as a selection problem: your data has been filtered before you ever looked at it.
- 2. Abraham Wald and the Bomber That Came BackTells the WWII story of the Statistical Research Group's analysis of bullet holes on returning aircraft and Wald's counterintuitive recommendation.
- 3. The Math Behind the Missing HolesFormalizes the bomber problem with conditional probability, showing how P(hit | survived) systematically understates vulnerable areas.
- 4. Survivorship Bias in the WildWalks through modern examples — mutual fund returns, successful-founder advice, old buildings, and dead-letter data — where the same error appears.
- 5. A Checklist for Spotting Filtered DataGives students a practical routine of questions to ask before trusting any dataset or success story.
- 6. Why This Matters Beyond Statistics ClassConnects survivorship bias to decision-making, media literacy, and other cognitive biases students will meet in economics, psychology, and history.