Standard Error and the CLT
What You'll Learn
You'll learn how the Central Limit Theorem gives us a precise formula for the spread of sample means, and why larger samples produce more reliable estimates.
The Standard Error Formula
The Central Limit Theorem doesn't just tell us that sampling distributions become normal—it also tells us exactly how spread out those sample means will be.
When you take samples of size n from a population with standard deviation σ, the standard deviation of the sampling distribution (called the standard error) is:
SE = σ / √n
This simple formula has profound implications.
Why √n Matters
Notice that the sample size appears in the denominator under a square root. This means:
- Doubling your sample size doesn't cut the standard error in half—it reduces it by a factor of √2 ≈ 1.41
- Quadrupling your sample size cuts the standard error in half
- Larger samples = tighter clustering of sample means around the true population mean
Think of it like this: If one person's measurement might be way off, averaging 100 people's measurements smooths out the randomness. The √n tells you how much smoother.
Example Insight
If a population has σ = 20:
- Sample size n = 25 → SE = 20/√25 = 20/5 = 4
- Sample size n = 100 → SE = 20/√100 = 20/10 = 2
With four times the data, your sample means vary half as much!
Key Takeaway: The CLT tells us the standard error (spread of sample means) equals σ/√n, meaning precision improves with the square root of sample size—bigger samples give more stable, reliable estimates.