Course contentsShow
← Mathematics
Lesson 2973 of 3,12158. Joint and Limit BehaviorFree lesson

Strong Law of Large Numbers: Statement

State the Strong Law of Large Numbers: sample means converge almost surely to the expected value.

Strong Law of Large Numbers: Statement

What You'll Learn

You'll learn how the Strong Law of Large Numbers guarantees that sample averages converge almost surely to the true expected value—a more powerful result than the Weak Law.

The Core Idea

You've already seen the Weak Law of Large Numbers, which tells us that sample means converge in probability to the expected value. The Strong Law of Large Numbers (SLLN) makes an even stronger guarantee: sample means converge almost surely.

Here's the formal statement:

Let X1,X2,X3,…X_1, X_2, X_3, \ldots be an infinite sequence of independent and identically distributed (i.i.d.) random variables, each with finite mean μ=E[Xi]\mu = E[X_i]. Define the sample mean as:

Xˉn=X1+X2+⋯+Xnn\bar{X}_n = \frac{X_1 + X_2 + \cdots + X_n}{n}

Then:

P(lim⁡n→∞Xˉn=μ)=1P\left(\lim_{n \to \infty} \bar{X}_n = \mu\right) = 1

This notation means that with probability 1, the sample mean will actually converge to μ\mu as nn grows without bound.

What Makes It "Strong"?

The difference between convergence in probability (Weak Law) and almost sure convergence (Strong Law) is subtle but important:

  • Weak Law: For any given large nn, the sample mean is probably close to μ\mu
  • Strong Law: The entire sequence of sample means approaches μ\mu, and this happens for almost every possible outcome

Think of it like shooting arrows at a target. The Weak Law says each shot gets increasingly likely to hit near the bullseye. The Strong Law says that if you watch your entire infinite sequence of shots, the running average will hit the bullseye—this is guaranteed for almost every archer (every outcome).

Key Takeaway: The Strong Law of Large Numbers states that sample means converge almost surely to the population mean—a pathwise guarantee that the average stabilizes to μ\mu as n→∞n \to \infty with probability 1.