Course contentsShow
← Mathematics
Lesson 2969 of 3,12158. Joint and Limit BehaviorFree lesson

The Intuition Behind the Law of Large Numbers

Develop intuition for why averages stabilize as sample size increases using examples and simulations.

The Intuition Behind the Law of Large Numbers

You'll learn why averaging more observations makes results more predictable and stable.

The Core Idea

Imagine flipping a coin. After 10 flips, you might get 7 heads (70%)—far from the expected 50%. But after 1,000 flips, you'll likely see something close to 500 heads (50%). After 100,000 flips? Even closer to exactly 50%. This is the Law of Large Numbers in action: as your sample size grows, the sample mean converges toward the true population mean.

Why Does This Happen?

Think of it this way: early "unlucky" results (like getting 7 heads in 10 flips) have a big impact on your average when the sample is small. But as you collect more data, these early quirks get diluted by the sheer volume of new observations. The random fluctuations don't disappear—they just become less significant relative to the growing total.

Analogy: Imagine adding a tablespoon of salt to a cup of water versus adding it to a swimming pool. In the cup, you'd taste it immediately. In the pool, it's undetectable. Similarly, random deviations become "invisible" as sample size increases.

Simulation Example

If you rolled a fair die repeatedly and computed the running average:

  • After 5 rolls: might be 4.2 (pretty far from 3.5)
  • After 50 rolls: maybe 3.7 (getting closer)
  • After 5,000 rolls: perhaps 3.501 (very close to 3.5)

The average stabilizes because extreme values become rare outliers rather than dominant forces.

Key Takeaway: The Law of Large Numbers guarantees that sample means become arbitrarily close to the true mean as sample size increases—random noise averages out, revealing the underlying signal.