What the Central Limit Theorem States
You'll learn: The powerful principle that explains why sampling distributions of means tend to look normal, even when the original data doesn't.
The Core Idea
The Central Limit Theorem (CLT) is one of the most important results in statistics. It states that when you repeatedly take random samples from any population and calculate the mean of each sample, those sample means will form a distribution that becomes increasingly normal as your sample size grows—regardless of the original population's shape.
Let me say that again: even if your population is highly skewed, uniform, or wildly irregular, the distribution of sample means will approach a normal distribution as you increase the sample size.
Why This Matters
Imagine you're measuring the income of residents in a city—income data is typically right-skewed (most people earn moderate amounts, a few earn extremely high amounts). If you take many random samples of 50 people, calculate each sample's mean income, and plot those means, you'll see something surprising: the histogram of those means looks bell-shaped and normal, even though individual incomes don't.
This is why we can use Z-scores, confidence intervals, and other normal-distribution-based tools in practice—the CLT ensures that sampling distributions behave predictably.
The Key Ingredients
- Sample size matters: Typically, n ≥ 30 is considered sufficient for the CLT to "kick in," though it depends on how non-normal the original population is.
- Independence: Samples must be randomly and independently drawn.
- Any shape: The original population can be uniform, exponential, Poisson, or anything else.
Key Takeaway: The Central Limit Theorem tells us that sampling distributions of means become approximately normal as sample size increases, no matter what shape the original population has—this is why normal distributions are so central to statistical inference.