Course contentsShow
← Machine Learning and Deep Learning
Lesson 3048 of 3,53866. Production Monitoring and Data DriftFree lesson

Retraining Strategies for Concept Drift

When and how to retrain models, choosing between full retraining, incremental learning, and online learning approaches.

Retraining Strategies for Concept Drift

What you'll learn: How to decide when and how to retrain your production models in response to concept drift.

The Core Challenge

Once you've detected concept drift (the relationship between inputs and outputs has changed), you need a retraining strategy. The key question: do you rebuild everything from scratch, update incrementally, or learn continuously in real-time?

Think of it like maintaining a restaurant menu: you could redesign the entire menu seasonally (full retraining), adjust recipes gradually based on feedback (incremental learning), or adapt dishes on-the-fly each service (online learning).

Three Retraining Approaches

Full Retraining

Retrain the entire model from scratch using all available data (or a recent window). This is the safest approach—you get a fresh model with consistent behavior. Use when you have sufficient computational resources, ground truth labels arrive in batches, and you can afford scheduled downtime or A/B testing periods.

When: Major drift detected, quarterly/monthly scheduled updates, after significant system changes.

Incremental Learning

Update an existing model with new data without retraining from scratch. The model learns new patterns while attempting to preserve old knowledge. This is faster and more resource-efficient but risks catastrophic forgetting.

When: Continuous moderate drift, resource constraints, need frequent updates (daily/weekly).

Online Learning

Update the model continuously with each new observation or mini-batch. The model adapts in real-time to changing patterns. Requires careful learning rate tuning and monitoring to prevent instability.

When: Rapid concept drift, streaming data scenarios, recommendation systems, ad click prediction.

Decision Framework

Choose based on: drift severity (gradual vs sudden), ground truth availability (batched vs streaming), computational budget, and risk tolerance for temporary degradation.

Key Takeaway: Match your retraining strategy to your drift pattern—full retraining for stability and major changes, incremental for balanced updates, and online learning for real-time adaptation in high-velocity environments.