Deriving Bayes' Theorem
What you'll learn: You'll see exactly how Bayes' Theorem emerges naturally from the definition of conditional probability and the multiplication rule.
The Core Idea
You already know that conditional probability is defined as:
and similarly:
The multiplication rule tells us we can rearrange these:
Here's the key insight: the intersection is symmetric—. Both expressions equal the same thing, so we can set them equal:
Now divide both sides by (assuming ):
This is Bayes' Theorem.
Why It Matters
Bayes' Theorem lets you "flip" conditional probabilities. If you know but need , this formula shows you how to convert between them using the marginal probabilities and .
Think of it as a bridge: you might know the probability of symptoms given a disease, but what you really want is the probability of disease given symptoms. Bayes flips that relationship.
Key Takeaway: Bayes' Theorem follows directly from the definition of conditional probability and the symmetry of intersection—it's not a separate axiom, but a logical consequence of what we already know.