The t-Distribution: Properties and Degrees of Freedom
You'll learn: How the t-distribution's shape changes with degrees of freedom and why it matters for small-sample inference.
What Is the t-Distribution?
The t-distribution is a bell-shaped probability distribution that looks similar to the standard normal distribution but with heavier tails. It was developed to handle situations where we estimate the population standard deviation from a small sample. Unlike the normal distribution (which has a fixed shape), the t-distribution's exact form depends on a parameter called degrees of freedom (df).
Key Properties
- Bell-shaped and symmetric around zero, just like the normal distribution
- Heavier tails than the normal distribution—meaning more probability in the extremes
- Changes shape based on degrees of freedom
- Mean = 0 (when df > 1)
- Variance = df/(df - 2) (when df > 2), which is always greater than 1
Degrees of Freedom Explained
Degrees of freedom (df) typically equals n - 1 for a one-sample problem, where n is your sample size. Think of it as the "effective information" in your sample after estimating parameters.
As df increases:
- The t-distribution becomes narrower and closer to the normal distribution
- The tails become lighter
- When df ≥ 30, the t-distribution is nearly indistinguishable from the standard normal
With small df (like 3 or 5), the heavy tails reflect our increased uncertainty when working with tiny samples—we need wider intervals to maintain the same confidence level.
Key Takeaway: The t-distribution accounts for extra uncertainty in small samples through heavier tails that lighten as degrees of freedom increase, converging to the normal distribution for large samples.