Course contentsShow
← Mathematics
Lesson 2979 of 3,12158. Joint and Limit BehaviorFree lesson

CLT for Independent Identically Distributed Variables

State the CLT rigorously for i.i.d. random variables with finite mean and variance.

CLT for Independent Identically Distributed Variables

What You'll Learn

You'll see the rigorous mathematical statement of the Central Limit Theorem for i.i.d. random variables with finite mean and variance.

The Rigorous Statement

After building intuition about the Central Limit Theorem, we now state it precisely for the most common scenario: independent, identically distributed (i.i.d.) random variables.

Central Limit Theorem (CLT) for i.i.d. Variables:

Let X₁, X₂, X₃, ... be a sequence of independent and identically distributed random variables, each with:

  • Finite mean: E[Xᵢ] = μ
  • Finite variance: Var(Xᵢ) = σ² > 0

Define the sample mean: X̄ₙ = (X₁ + X₂ + ... + Xₙ)/n

Then, as n → ∞, the standardized sample mean converges in distribution to a standard normal:

Z_n = (X̄ₙ - μ)/(σ/√n) →ᵈ N(0,1)

Equivalently, the sample mean itself is approximately normal for large n:

X̄ₙ ~ N(μ, σ²/n) approximately, for large n

What This Means

No matter what the original distribution of the Xᵢ variables looks like (uniform, exponential, binomial, etc.), their average becomes approximately normally distributed once you have enough samples. The standardization using σ/√n (the standard error) ensures the limiting distribution has mean 0 and variance 1.

The conditions are crucial: the variables must be independent, identically distributed, and have finite variance. Without these, the CLT may not hold.

Key Takeaway: The CLT rigorously guarantees that standardized sample means of i.i.d. variables with finite mean μ and variance σ² converge to a standard normal distribution as sample size approaches infinity.