Basic Applications of Bayes' Theorem
What you'll learn: You'll apply Bayes' Theorem to solve real-world problems involving diagnostic tests, false positives, and reversing conditional probabilities.
The Core Idea
Bayes' Theorem shines when we need to "flip" a conditional probability. A classic scenario: given that a medical test is positive, what's the probability you actually have the disease? This is not the same as the test's accuracy rate—it depends critically on how rare the disease is in the population.
The formula you've already derived is:
P(A|B) = P(B|A) · P(A) / P(B)
In diagnostic contexts, we rewrite this as:
P(Disease|Positive) = P(Positive|Disease) · P(Disease) / P(Positive)
A Diagnostic Test Example
Suppose a disease affects 1% of the population. A test is 95% accurate: it correctly identifies 95% of sick people (true positives) and 95% of healthy people (true negatives, meaning 5% false positives).
Given: You test positive. What's the probability you're actually sick?
- P(Disease) = 0.01
- P(Positive|Disease) = 0.95 (sensitivity)
- P(Positive|Healthy) = 0.05 (false positive rate)
Using the Law of Total Probability:
P(Positive) = P(Positive|Disease)·P(Disease) + P(Positive|Healthy)·P(Healthy)
= 0.95·0.01 + 0.05·0.99 = 0.0095 + 0.0495 = 0.059
Now apply Bayes:
P(Disease|Positive) = (0.95 · 0.01) / 0.059 ≈ 0.161 or 16.1%
Surprising result: Even with a positive test, you only have about a 16% chance of being sick, because the disease is rare!
Key Takeaway: Bayes' Theorem reverses conditional probabilities and reveals that even accurate tests produce many false positives when screening for rare conditions—always account for the base rate (prior probability).