Course contentsShow
← Machine Learning and Deep Learning
Lesson 545 of 3,53813. Imbalanced and Multi-Label ProblemsFree lesson

Threshold Adjustment for Imbalanced Data

Shift decision thresholds on predicted probabilities to optimize precision-recall trade-offs for the minority class.

Threshold Adjustment for Imbalanced Data

What you'll learn: How to shift decision thresholds on predicted probabilities to better handle minority classes in imbalanced datasets.

The Core Idea

Most classifiers output probabilities (like 0.73 for "positive" and 0.27 for "negative"), then use a default threshold of 0.5 to make the final decision. But when your data is imbalanced—say, 95% negative cases and 5% positive—this default threshold often fails the minority class.

Threshold adjustment means changing that cutoff point. Instead of "predict positive if probability ≥ 0.5," you might use "predict positive if probability ≥ 0.3." This simple shift can dramatically improve recall for the minority class, at the cost of some precision.

Why This Matters for Imbalance

Think of a fraud detection system: missing fraud (low recall) is costly, but investigating false alarms (low precision) is manageable. By lowering the threshold from 0.5 to, say, 0.2, you catch more fraud cases even though you trigger more false alarms.

The beauty? You don't retrain your model. You simply reinterpret its probability outputs differently.

Choosing Your Threshold

Use the Precision-Recall curve you've already learned about. Plot how precision and recall change across different thresholds, then pick the point that matches your business needs:

  • Need high recall? Lower the threshold
  • Need high precision? Raise the threshold
  • Want balance? Use F1 or F-beta score to find the optimal point

Practical Flow

  1. Train your model normally (possibly with class weights)
  2. Get predicted probabilities on validation data
  3. Sweep thresholds from 0.0 to 1.0
  4. Calculate precision, recall, F1 at each threshold
  5. Select threshold that optimizes your target metric

Key Takeaway: Threshold adjustment is a post-training technique that lets you optimize precision-recall trade-offs for imbalanced data by simply changing the probability cutoff, without retraining your model.