Course contentsShow
← Mathematics
Lesson 2814 of 3,12155. Probability — FoundationsFree lesson

Deriving Bayes' Theorem

Proving Bayes' Theorem using the definition of conditional probability and the multiplication rule.

Deriving Bayes' Theorem

What you'll learn: You'll see exactly how Bayes' Theorem emerges naturally from the definition of conditional probability and the multiplication rule.

The Core Idea

You already know that conditional probability is defined as:

P(A∣B)=P(A∩B)P(B)P(A|B) = \frac{P(A \cap B)}{P(B)}

and similarly:

P(B∣A)=P(B∩A)P(A)P(B|A) = \frac{P(B \cap A)}{P(A)}

The multiplication rule tells us we can rearrange these:

P(A∩B)=P(A∣B)⋅P(B)P(A \cap B) = P(A|B) \cdot P(B) P(B∩A)=P(B∣A)⋅P(A)P(B \cap A) = P(B|A) \cdot P(A)

Here's the key insight: the intersection is symmetric—P(A∩B)=P(B∩A)P(A \cap B) = P(B \cap A). Both expressions equal the same thing, so we can set them equal:

P(A∣B)⋅P(B)=P(B∣A)⋅P(A)P(A|B) \cdot P(B) = P(B|A) \cdot P(A)

Now divide both sides by P(B)P(B) (assuming P(B)>0P(B) > 0):

P(A∣B)=P(B∣A)⋅P(A)P(B)P(A|B) = \frac{P(B|A) \cdot P(A)}{P(B)}

This is Bayes' Theorem.

Why It Matters

Bayes' Theorem lets you "flip" conditional probabilities. If you know P(B∣A)P(B|A) but need P(A∣B)P(A|B), this formula shows you how to convert between them using the marginal probabilities P(A)P(A) and P(B)P(B).

Think of it as a bridge: you might know the probability of symptoms given a disease, but what you really want is the probability of disease given symptoms. Bayes flips that relationship.

Key Takeaway: Bayes' Theorem follows directly from the definition of conditional probability and the symmetry of intersection—it's not a separate axiom, but a logical consequence of what we already know.