Introduction to the Central Limit Theorem
What you'll learn: You'll discover why sample means from almost any distribution tend to form a bell curve when the sample size is large enough.
The Big Idea
The Central Limit Theorem (CLT) is one of the most powerful results in probability theory. Here's what it says:
When you take a large random sample from any population (with finite mean μ and variance σ²) and calculate the sample mean, that sample mean will be approximately normally distributed—regardless of the original population's shape.
Why This Matters
Imagine flipping a coin (definitely not normal—just 0s and 1s), or rolling a die (uniform distribution), or measuring times between events (exponential). The individual data points follow their own distinct distributions. But here's the magic: if you repeatedly take samples of size n and compute their averages, those averages cluster into a normal distribution as n grows large.
The sample mean X̄ₙ = (X₁ + X₂ + ... + Xₙ)/n will approximately follow:
X̄ₙ ~ N(μ, σ²/n)
Notice the variance shrinks by a factor of n—larger samples give more precise estimates.
The Practical Upshot
This explains why the normal distribution appears everywhere in statistics: it's not that everything is naturally normal, but rather that averages naturally become normal. This justifies using normal-based methods (confidence intervals, hypothesis tests) even when the underlying data isn't normal—as long as your sample is large enough (typically n ≥ 30 is a rough guideline).
Key Takeaway: The Central Limit Theorem states that sample means approximate a normal distribution for sufficiently large samples, regardless of the population's original distribution—making the normal distribution central to statistical inference.