Weak Law of Large Numbers: Statement
What you'll learn: You'll see the formal mathematical statement of the Weak Law of Large Numbers, which tells us exactly how sample means behave as sample size grows.
The Formal Statement
After building intuition about how averages stabilize with more data, we're ready for the precise mathematical claim.
Let X₁, X₂, X₃, ... be a sequence of independent and identically distributed (i.i.d.) random variables, each with:
- The same expected value: E[Xᵢ] = μ
- The same finite variance: Var(Xᵢ) = σ² < ∞
Define the sample mean of the first n observations:
X̄ₙ = (X₁ + X₂ + ... + Xₙ) / n
The Weak Law of Large Numbers states:
For any ε > 0 (no matter how small),
lim (n→∞) P(|X̄ₙ - μ| < ε) = 1
Equivalently: X̄ₙ converges in probability to μ, written X̄ₙ →ᵖ μ.
What This Means
This says the probability that the sample mean falls within any fixed distance ε from the true mean μ approaches 1 as n grows large. The sample mean gets arbitrarily close to the population mean with arbitrarily high probability—but we're not saying it always equals μ (that would be too strong).
Think of it as: given enough data, the chance of your sample average being "way off" from the true average becomes vanishingly small.
Key Takeaway: The Weak Law of Large Numbers formally guarantees that sample means X̄ₙ converge in probability to the population mean μ as n→∞, provided the observations are i.i.d. with finite variance.