Decision Rules: Reject or Fail to Reject
What you'll learn: How to make a formal decision about your null hypothesis using p-values and critical values.
The Core Decision Framework
After calculating your test statistic and p-value, you need a clear rule to decide whether your evidence is strong enough to reject the null hypothesis. This is where decision rules come in—they're the "if-then" statements that translate your numerical results into conclusions.
Two Approaches to the Same Decision
P-Value Approach:
- If p-value ≤ α: Reject H₀ (the data are unlikely under the null hypothesis)
- If p-value > α: Fail to reject H₀ (insufficient evidence against the null)
Critical Value Approach:
- If test statistic falls in the rejection region: Reject H₀
- If test statistic does NOT fall in the rejection region: Fail to reject H₀
Both methods lead to identical conclusions—they're just two ways of applying your significance level (α).
Why "Fail to Reject" Instead of "Accept"?
Think of hypothesis testing like a courtroom: failing to convict someone doesn't prove innocence; it means there wasn't enough evidence for conviction. Similarly, failing to reject H₀ doesn't prove it's true—it just means your sample didn't provide strong enough evidence against it.
Example Decision Statement
"With p-value = 0.032 and α = 0.05, since 0.032 < 0.05, we reject the null hypothesis. The data provide sufficient evidence at the 5% significance level to conclude that the population mean differs from 100."
Key Takeaway: Decision rules formalize the rejection criterion: reject H₀ when p-value ≤ α (or test statistic exceeds critical value), otherwise fail to reject H₀—never "accept" it.