SOLID STATE PRESS
← Back to catalog
Bayes' Theorem cover
Buy on Amazon
US list price $2.99
Mathematics

Bayes' Theorem

Conditional Probability, Priors, and Updating Beliefs with Evidence — A TLDR Primer

Bayes' Theorem shows up on statistics exams, in data science interviews, in courtroom arguments, and in your spam folder — but most students first encounter it as a confusing formula with no clear story behind it. This guide fixes that.

**Bayes' Theorem Explained** walks you through the logic step by step, short by design and stripped to essentials. You will start with conditional probability and the simple idea of restricting a sample space, then watch the theorem fall out naturally from definitions you already know. Every term — prior, likelihood, evidence, posterior — gets a plain-language name before it gets a symbol.

The core of the guide is the medical test problem, the most important application of bayesian reasoning for students to understand. A test that is 99% accurate can still leave you more likely healthy than sick after a positive result — and once you see exactly why, you will never misread a probability claim the same way again. From there, the guide covers Bayesian updating (how beliefs shift as new evidence arrives), walks through the Monty Hall problem, and connects the theorem to real-world uses in spam filters, legal evidence standards, and scientific hypothesis testing.

Written for high school and early college students who need to understand probability deeply, not just pass a multiple-choice question. Parents helping with AP Statistics or introductory college courses will find it equally useful as a fast orientation.

If conditional probability has felt slippery until now, pick this up and work through it today.

What you'll learn
  • Define conditional probability and read the notation P(A|B) fluently
  • State Bayes' Theorem and explain each term: prior, likelihood, evidence, posterior
  • Apply Bayes to classic problems like medical testing and false positives
  • Recognize the base rate fallacy and other common Bayesian mistakes
  • Use Bayesian updating to revise beliefs as new evidence arrives
What's inside
  1. 1. Conditional Probability: The Setup
    Introduces probability notation, conditional probability, and the intuition of restricting the sample space.
  2. 2. Deriving Bayes' Theorem
    Builds the formula from the definition of conditional probability and names each piece: prior, likelihood, evidence, posterior.
  3. 3. The Medical Test Problem and the Base Rate Fallacy
    Works the classic disease-testing example in detail and explains why a 'positive' test can still mean you're probably healthy.
  4. 4. Bayesian Updating: Beliefs that Change with Evidence
    Shows how to apply Bayes repeatedly as new data arrives, with worked examples on coin bias and the Monty Hall problem.
  5. 5. Why Bayes Matters: Spam Filters, Courts, and Science
    Connects the theorem to real applications and to the broader debate about how we should weigh evidence.
Published by Solid State Press · June 2026
Bayes' Theorem cover
TLDR STUDY GUIDES

Bayes' Theorem

Conditional Probability, Priors, and Updating Beliefs with Evidence — A TLDR Primer
Solid State Press

Bayes' Theorem

Conditional Probability, Priors, and Updating Beliefs with Evidence — A TLDR Primer

Copyright © 2026 Solid State Press.

Published by Solid State Press.

All rights reserved. No part of this book may be reproduced or transmitted in any form without prior written permission, except for brief quotations in critical reviews and educational use.

Part of the TLDR Study Guides series.

Contents

  1. 1 Conditional Probability: The Setup
  2. 2 Deriving Bayes' Theorem
  3. 3 The Medical Test Problem and the Base Rate Fallacy
  4. 4 Bayesian Updating: Beliefs that Change with Evidence
  5. 5 Why Bayes Matters: Spam Filters, Courts, and Science
Chapter 1

Conditional Probability: The Setup

Every probability statement is secretly an answer to the question: out of what? Getting that question right is the whole game.

Probability is a number between 0 and 1 that measures how likely an outcome is. An outcome of 0 means impossible; an outcome of 1 means certain. Everything in between is uncertainty. To assign a probability, you first need a sample space — the complete set of all possible outcomes for whatever situation you're analyzing. If you flip a fair coin, the sample space is {Heads, Tails}. If you roll a standard six-sided die, the sample space is {1, 2, 3, 4, 5, 6}.

An event is any subset of the sample space — any collection of outcomes you care about. "Rolling an even number" is an event: it contains {2, 4, 6}. The probability of an event A, written $P(A)$, is the fraction of the sample space that A occupies, assuming all outcomes are equally likely. For the even-number event:

$P(\text{even}) = \frac{3}{6} = 0.5$

When outcomes aren't equally likely, you weight them by how often they occur — but the notation $P(A)$ stays the same. Think of $P(A)$ as your best measure of how large event A is relative to the whole picture.

Shrinking the Picture: Conditional Probability

Now here is the key move. Suppose you already know something happened. That knowledge rules out part of the sample space. Whatever is left — the outcomes still consistent with what you know — becomes your new, smaller sample space. Conditional probability is just probability recalculated inside that shrunken space.

The notation is $P(A \mid B)$, read aloud as "the probability of A given B." The vertical bar means "given that we know B has occurred." You are no longer asking how big A is relative to everything — you're asking how big the overlap between A and B is, relative to B alone.

Formally:

$P(A \mid B) = \frac{P(A \text{ and } B)}{P(B)}$

The numerator $P(A \text{ and } B)$ — sometimes written $P(A \cap B)$ — is the probability that both events happen together. The denominator $P(B)$ rescales everything so that, inside the world where B is true, all the probabilities still add up to 1.

About This Book

If you're a high school student hitting conditional probability in your math or statistics class, a college freshman working through probability and statistics exam prep, or anyone who has searched "how to understand Bayes' Theorem easily" and gotten a wall of jargon in return — this book is for you. It also works for tutors running a single-session review and parents trying to follow along with their student's homework.

This guide covers Bayes' Theorem explained for beginners: what conditional probability means, how the theorem is derived, and why medical test false positive probability explained through Bayes stops people from making dangerous errors. You'll also meet the base rate fallacy, a statistics concept that trips up doctors, jurors, and journalists alike, and get a grounded introduction to Bayesian reasoning for students who want to think clearly about evidence. Short by design, no filler.

Read straight through once to build the framework. Then work every example actively — cover the solution and try it yourself first. Finish with the problem set to confirm you can apply it cold.

Keep reading

You've read the first half of Chapter 1. The complete book covers 5 chapters in roughly fifteen pages — readable in one sitting.

Continue reading on Amazon