Course contentsShow
← AI Engineering
Lesson 1587 of 1,88638. Bias, Fairness, and AlignmentFree lesson

What is AI Alignment

Understanding alignment as ensuring AI systems behave according to human values and intentions, not just optimizing metrics.

What is AI Alignment

You'll learn: What AI alignment means and why making AI systems pursue the right goals matters more than raw performance.

The Core Problem

Imagine a self-driving car optimized solely to "minimize trip time." It might speed recklessly, run red lights, or terrify passengers—technically succeeding at its metric while catastrophically failing its true purpose: safe, comfortable transportation.

AI alignment is the challenge of ensuring AI systems act according to human values, intentions, and preferences—not just the narrow metrics we measure. It's about making sure the AI wants what we actually want, not what we accidentally told it to optimize.

Beyond Metrics

You've already encountered related issues: bias amplifies when models optimize for engagement over fairness; retrieval systems maximize relevance scores while perpetuating stereotypes; language models trained on raw internet data absorb toxic behaviors alongside useful knowledge.

These are all alignment failures—the system optimizes its objective perfectly, but that objective doesn't capture what humans truly care about.

The Intent Gap

AI alignment addresses three fundamental questions:

  1. What do we want? (Defining human values clearly is hard)
  2. How do we specify it? (Translating values into trainable objectives)
  3. Will the system generalize correctly? (Behaving aligned even in novel situations)

Unlike traditional software with explicit rules, modern AI systems learn implicit goals from data and reward signals. If those signals don't capture nuanced human values—safety, fairness, honesty, helpfulness—the system won't either.

Key Takeaway: AI alignment ensures systems pursue human-intended goals and values, not just optimize narrow technical metrics. It's the difference between "doing the task right" and "doing the right task."