Covariates and External Features in Foundation Forecasting
What You'll Learn
You'll learn how to incorporate external variables and metadata into foundation forecasting models to improve prediction accuracy beyond pure historical patterns.
The Core Idea
Foundation models for time series don't forecast in a vacuum—real-world predictions often depend on external factors. Covariates are additional input features that influence your target variable but aren't the series itself.
Think of forecasting ice cream sales: the historical sales pattern helps, but knowing tomorrow's weather forecast (temperature, sunshine) dramatically improves predictions. These external variables are covariates.
Types of Features in Foundation Forecasting
Exogenous Variables (Known Future Covariates)
Variables you know ahead of time: calendar features (day of week, holidays), scheduled events, or planned promotions. Foundation models use these to condition their predictions on future context.
Static Features
Time-invariant metadata like product category, store location, or customer segment. These help the model learn different behavioral patterns across entities in a single training run.
Temporal Metadata
Time-based attributes already encoded from your time series structure: hour of day, month, seasonality indicators. Foundation models often learn these automatically, but explicit encoding can boost performance.
How Foundation Models Handle Covariates
Unlike classical ARIMA models (which struggle with external features), foundation forecasters like TimeGPT and Temporal Fusion Transformers are designed to naturally blend:
- Historical target values
- Past covariate observations
- Future known covariates
- Static metadata embeddings
The model learns attention patterns that weight these features appropriately, discovering which covariates matter most for each prediction horizon.
Why This Matters
Without covariates, you're forecasting blindly. With them, your foundation model becomes context-aware, adapting predictions to special events, external shocks, and cross-sectional differences—essential for real-world deployment.
Key Takeaway: Covariates and external features transform foundation forecasting models from pattern-matchers into context-aware predictors that leverage all available information, not just historical values.