Course contentsShow
← System Design
Lesson 44 of 1,9192. Scaling FoundationsFree lesson

What is Horizontal Scaling?

Understanding horizontal scaling: adding more machines to distribute load across multiple instances.

What is Horizontal Scaling?

What you'll learn: How to handle growing traffic by adding more machines instead of making one machine more powerful.

The Core Idea

Horizontal scaling means increasing your system's capacity by adding more servers (machines) to distribute the workload across multiple instances. Instead of upgrading a single server to handle more load (vertical scaling), you add copies of that server and split traffic between them.

Think of it like a grocery store: when lines get too long, instead of training one cashier to work faster (vertical scaling), you open more checkout lanes with additional cashiers (horizontal scaling). Each cashier handles a portion of customers, and collectively they process everyone faster.

How It Works

When you scale horizontally, you:

  • Deploy multiple identical servers running your application
  • Use a load balancer to distribute incoming requests across these servers
  • Add or remove servers based on traffic demands

For example, if one server can handle 1,000 QPS, adding four more servers gives you approximately 5,000 QPS capacity.

Why It Matters

Horizontal scaling addresses several problems that vertical scaling cannot:

  • No single point of failure: If one server crashes, others continue serving traffic
  • Theoretically unlimited growth: Keep adding machines as needed
  • Cost flexibility: Use smaller, cheaper commodity hardware instead of expensive high-end machines
  • Geographic distribution: Place servers closer to users in different regions

This approach aligns with "Design for Change" and "Prefer Boring Technology" principles—you use simple, proven hardware and can adapt capacity as requirements evolve.

Key Takeaway: Horizontal scaling grows your system by adding more machines to share the load, providing better reliability and flexibility than upgrading a single powerful server.