Strong Law of Large Numbers: Statement
What You'll Learn
You'll learn how the Strong Law of Large Numbers guarantees that sample averages converge almost surely to the true expected value—a more powerful result than the Weak Law.
The Core Idea
You've already seen the Weak Law of Large Numbers, which tells us that sample means converge in probability to the expected value. The Strong Law of Large Numbers (SLLN) makes an even stronger guarantee: sample means converge almost surely.
Here's the formal statement:
Let be an infinite sequence of independent and identically distributed (i.i.d.) random variables, each with finite mean . Define the sample mean as:
Then:
This notation means that with probability 1, the sample mean will actually converge to as grows without bound.
What Makes It "Strong"?
The difference between convergence in probability (Weak Law) and almost sure convergence (Strong Law) is subtle but important:
- Weak Law: For any given large , the sample mean is probably close to
- Strong Law: The entire sequence of sample means approaches , and this happens for almost every possible outcome
Think of it like shooting arrows at a target. The Weak Law says each shot gets increasingly likely to hit near the bullseye. The Strong Law says that if you watch your entire infinite sequence of shots, the running average will hit the bullseye—this is guaranteed for almost every archer (every outcome).
Key Takeaway: The Strong Law of Large Numbers states that sample means converge almost surely to the population mean—a pathwise guarantee that the average stabilizes to as with probability 1.