Course contentsShow
← Mathematics
Lesson 2970 of 3,12158. Joint and Limit BehaviorFree lesson

Weak Law of Large Numbers: Statement

State the Weak Law of Large Numbers formally: sample means converge in probability to the expected value.

Weak Law of Large Numbers: Statement

What you'll learn: You'll see the formal mathematical statement of the Weak Law of Large Numbers, which tells us exactly how sample means behave as sample size grows.

The Formal Statement

After building intuition about how averages stabilize with more data, we're ready for the precise mathematical claim.

Let X₁, X₂, X₃, ... be a sequence of independent and identically distributed (i.i.d.) random variables, each with:

  • The same expected value: E[Xᵢ] = μ
  • The same finite variance: Var(Xᵢ) = σ² < ∞

Define the sample mean of the first n observations:

X̄ₙ = (X₁ + X₂ + ... + Xₙ) / n

The Weak Law of Large Numbers states:

For any ε > 0 (no matter how small),

lim (n→∞) P(|X̄ₙ - μ| < ε) = 1

Equivalently: X̄ₙ converges in probability to μ, written X̄ₙ →ᵖ μ.

What This Means

This says the probability that the sample mean falls within any fixed distance ε from the true mean μ approaches 1 as n grows large. The sample mean gets arbitrarily close to the population mean with arbitrarily high probability—but we're not saying it always equals μ (that would be too strong).

Think of it as: given enough data, the chance of your sample average being "way off" from the true average becomes vanishingly small.

Key Takeaway: The Weak Law of Large Numbers formally guarantees that sample means X̄ₙ converge in probability to the population mean μ as n→∞, provided the observations are i.i.d. with finite variance.