Course contentsShow
← System Design
Lesson 84 of 1,9193. Load BalancingFree lesson

Load Balancer Performance Metrics

Learn key metrics to monitor: throughput, latency, connection counts, and backend health.

Load Balancer Performance Metrics

What you'll learn: How to measure whether your load balancer is doing its job well by tracking four essential metrics.

Why Monitor Your Load Balancer?

A load balancer sits between clients and your backend servers, directing traffic where it needs to go. But how do you know if it's working efficiently? Just like checking your car's dashboard for speed, fuel, and engine temperature, you need specific metrics to understand your load balancer's health and performance.

The Four Key Metrics

1. Throughput

Measures how many requests the load balancer can handle per second (often in QPS - queries per second). If throughput drops below expected levels, your load balancer may be overwhelmed or misconfigured.

2. Latency

The time delay the load balancer adds to each request. Ideally, this should be minimal (single-digit milliseconds). High latency here means your load balancer itself is becoming a bottleneck, defeating its purpose.

3. Connection Counts

Tracks both active connections and new connections per second. A sudden spike might indicate a traffic surge or attack. Watching this metric helps you understand if you're approaching the load balancer's connection limits.

4. Backend Health

Monitors which backend servers are up, down, or degraded. A load balancer should only route traffic to healthy backends. This metric tells you if your servers behind the load balancer are responding correctly to health checks.

Why These Matter Together

Think of these metrics as a complete picture: throughput tells you volume, latency tells you speed, connection counts tell you capacity usage, and backend health tells you destination quality. All four together reveal whether your load balancing strategy is working.

Key Takeaway: Monitor throughput, latency, connection counts, and backend health to ensure your load balancer efficiently distributes traffic without becoming a bottleneck itself.