Course contentsShow
← Data Science
Lesson 327 of 2,1459. Hypothesis Testing FoundationsFree lesson

Decision Rules: Reject or Fail to Reject

Formulating clear decision criteria comparing p-values to α or test statistics to critical values.

Decision Rules: Reject or Fail to Reject

What you'll learn: How to make a formal decision about your null hypothesis using p-values and critical values.

The Core Decision Framework

After calculating your test statistic and p-value, you need a clear rule to decide whether your evidence is strong enough to reject the null hypothesis. This is where decision rules come in—they're the "if-then" statements that translate your numerical results into conclusions.

Two Approaches to the Same Decision

P-Value Approach:

  • If p-value ≤ α: Reject H₀ (the data are unlikely under the null hypothesis)
  • If p-value > α: Fail to reject H₀ (insufficient evidence against the null)

Critical Value Approach:

  • If test statistic falls in the rejection region: Reject H₀
  • If test statistic does NOT fall in the rejection region: Fail to reject H₀

Both methods lead to identical conclusions—they're just two ways of applying your significance level (α).

Why "Fail to Reject" Instead of "Accept"?

Think of hypothesis testing like a courtroom: failing to convict someone doesn't prove innocence; it means there wasn't enough evidence for conviction. Similarly, failing to reject H₀ doesn't prove it's true—it just means your sample didn't provide strong enough evidence against it.

Example Decision Statement

"With p-value = 0.032 and α = 0.05, since 0.032 < 0.05, we reject the null hypothesis. The data provide sufficient evidence at the 5% significance level to conclude that the population mean differs from 100."

Key Takeaway: Decision rules formalize the rejection criterion: reject H₀ when p-value ≤ α (or test statistic exceeds critical value), otherwise fail to reject H₀—never "accept" it.