CLT for Independent Identically Distributed Variables
What You'll Learn
You'll see the rigorous mathematical statement of the Central Limit Theorem for i.i.d. random variables with finite mean and variance.
The Rigorous Statement
After building intuition about the Central Limit Theorem, we now state it precisely for the most common scenario: independent, identically distributed (i.i.d.) random variables.
Central Limit Theorem (CLT) for i.i.d. Variables:
Let X₁, X₂, X₃, ... be a sequence of independent and identically distributed random variables, each with:
- Finite mean: E[Xᵢ] = μ
- Finite variance: Var(Xᵢ) = σ² > 0
Define the sample mean: X̄ₙ = (X₁ + X₂ + ... + Xₙ)/n
Then, as n → ∞, the standardized sample mean converges in distribution to a standard normal:
Z_n = (X̄ₙ - μ)/(σ/√n) →ᵈ N(0,1)
Equivalently, the sample mean itself is approximately normal for large n:
X̄ₙ ~ N(μ, σ²/n) approximately, for large n
What This Means
No matter what the original distribution of the Xᵢ variables looks like (uniform, exponential, binomial, etc.), their average becomes approximately normally distributed once you have enough samples. The standardization using σ/√n (the standard error) ensures the limiting distribution has mean 0 and variance 1.
The conditions are crucial: the variables must be independent, identically distributed, and have finite variance. Without these, the CLT may not hold.
Key Takeaway: The CLT rigorously guarantees that standardized sample means of i.i.d. variables with finite mean μ and variance σ² converge to a standard normal distribution as sample size approaches infinity.