What is Statistical Power?
You'll learn: How statistical power measures your test's ability to catch real effects when they exist.
The Core Idea
Statistical power is the probability that your hypothesis test will correctly reject a false null hypothesis. In simpler terms, it's your test's ability to detect a real effect when there truly is one.
Remember Type II errors (false negatives)? That's when you fail to reject the null hypothesis even though it's actually false—you miss a real effect. Power is directly related to avoiding these errors:
Power = 1 - β
Where β (beta) is the probability of making a Type II error.
Why Power Matters
Think of power like the sensitivity of a metal detector at the beach. A high-power detector (say, 90% power) will find 90 out of 100 buried coins. A low-power detector (30% power) will only find 30 out of 100, missing most of the treasure even though it's there.
In hypothesis testing:
- High power (0.80 or 80%): Your test is likely to detect a real effect
- Low power (0.30 or 30%): Your test will likely miss real effects, leading to false negatives
The Four Possibilities Revisited
| Reality → | H₀ True | H₀ False |
|---|---|---|
| Reject H₀ | Type I Error (α) | ✓ Correct (Power = 1-β) |
| Fail to Reject H₀ | ✓ Correct | Type II Error (β) |
Power lives in that top-right cell—correctly identifying when the null hypothesis is wrong.
Key Takeaway: Statistical power is your test's ability to detect real effects; higher power (typically ≥0.80) means you're less likely to miss important findings and commit Type II errors.