Course contentsShow
← System Design
Lesson 105 of 1,9193. Load BalancingFree lesson

Graceful Degradation and Circuit Breaking

When backends fail, load balancers can return errors gracefully or open circuits to prevent cascading failures across the system.

Graceful Degradation and Circuit Breaking

What You'll Learn

You'll learn how load balancers handle backend failures intelligently to prevent small problems from becoming system-wide disasters.

The Problem: Failures Cascade

When a backend server starts failing, naively continuing to send traffic to it creates two problems:

  1. User experience suffers — requests time out or return errors
  2. Failures spread — slow backends tie up connections, exhausting resources across the system

Imagine a restaurant kitchen catching fire. A good manager doesn't keep seating customers in that section — they gracefully redirect diners elsewhere or politely turn them away at the door.

Graceful Degradation

Graceful degradation means the system continues functioning in a reduced capacity rather than failing completely. When backends fail:

  • Return cached or default responses instead of errors
  • Serve partial results (e.g., show 8 of 10 product categories)
  • Disable non-critical features temporarily
  • Provide helpful error messages

The load balancer or application layer detects failures and adapts behavior automatically.

Circuit Breaking

A circuit breaker works like an electrical circuit breaker in your home. When a backend repeatedly fails:

  1. Closed state: Normal operation, requests flow through
  2. Open state: After threshold failures, stop sending requests entirely (fail fast)
  3. Half-open state: After cooldown period, try a few test requests to see if backend recovered

This prevents the "thundering herd" problem where thousands of requests pile up against a failing service, making recovery impossible.

The circuit breaker gives failing backends breathing room to recover while protecting the rest of the system.

Real-World Example

Netflix's Hystrix library popularized circuit breakers. When a recommendation service fails, Netflix shows generic recommendations instead of blank screens — degraded but functional.

Key Takeaway: Graceful degradation and circuit breaking transform catastrophic failures into manageable hiccups by failing fast, reducing load on struggling services, and providing fallback behavior.