Course contentsShow
← Computer Science
Lesson 2784 of 2,87262. Machine Learning FundamentalsFree lesson

Baseline Models and Evaluation

Establishing simple reference models to measure whether complex ML approaches provide real value.

Baseline Models and Evaluation

What you'll learn: You'll discover why starting with simple reference models is crucial for judging whether your complex machine learning solutions actually deliver value.

Why Baseline Models Matter

Before investing time in sophisticated neural networks or ensemble methods, you need a yardstick. A baseline model is an intentionally simple approach that establishes minimum acceptable performance. Think of it like timing yourself running a mile before starting a training program—you need to know your starting point to measure improvement.

Common Baseline Strategies

For classification problems, common baselines include:

  • Most frequent class: Always predict the majority label
  • Random guessing: Predict classes according to their distribution in training data

For regression problems, you might use:

  • Mean predictor: Always predict the average label value
  • Median predictor: Always predict the median (robust to outliers)

The Evaluation Connection

Baseline models work hand-in-hand with your loss function and evaluation metrics. If your fancy model achieves 70% accuracy but the "always predict the majority class" baseline gets 68%, you've barely improved! This reveals that your problem might have class imbalance or that your features aren't very informative.

Making Smart Decisions

By comparing your model's performance on test data against baseline performance, you can:

  • Justify the complexity you're adding
  • Identify when simpler is better (avoiding unnecessary bias-variance tradeoff complications)
  • Catch bugs (if you perform worse than baseline, something's wrong!)

Key Takeaway: Always establish simple baseline models before building complex solutions—they're your reality check for whether sophisticated ML approaches provide genuine value beyond naive predictions.