Course contentsShow
← System Design
Lesson 119 of 1,9193. Load BalancingFree lesson

Choosing Load Balancer Technology

Evaluate technology selection criteria based on scale, features, team expertise, cloud vs on-premise, and cost considerations.

Choosing Load Balancer Technology

What you'll learn: How to pick the right load balancer by weighing scale, features, expertise, deployment model, and cost.

The Selection Challenge

You've learned about many load balancing technologies—NGINX, HAProxy, cloud providers, Envoy, DNS-based solutions, and hardware options. But which one should you actually use? The answer depends on evaluating five key dimensions that match your system's reality, not theoretical ideals.

Five Selection Criteria

1. Scale Requirements

Match technology to your traffic volume. DNS-based solutions handle millions of QPS globally. Cloud load balancers scale automatically. A simple NGINX instance might suffice for modest traffic—don't over-engineer.

2. Required Features

Need Layer 7 routing? SSL termination? Advanced health checks? Map your must-have features (from previous lessons) to what each technology offers. HAProxy excels at TCP/HTTP. Envoy provides sophisticated observability.

3. Team Expertise

The best technology is the one your team can operate confidently. If you're expert in NGINX, that might beat a theoretically superior option you don't understand. Training costs and operational mistakes have real impact.

4. Cloud vs On-Premise

Cloud load balancers (AWS ALB, GCP Load Balancing) integrate seamlessly with cloud infrastructure and offer managed operations—no patching, scaling, or HA setup required. On-premise demands more control but requires you to manage everything yourself.

5. Cost Considerations

Cloud load balancers charge per hour plus data processed. Open-source software is "free" but requires engineering time, servers, and maintenance. Hardware load balancers have high upfront costs. Calculate total cost of ownership, not just license fees.

The Decision Matrix

Start simple. If you're on AWS and have standard needs, use ALB—it's boring technology that works. Use specialized solutions (Envoy, GSLB) only when you've outgrown simpler options or have specific requirements they uniquely address.

Key Takeaway: Choose load balancer technology by honestly assessing your scale, feature needs, team capabilities, infrastructure model, and total costs—prefer managed, boring solutions until you prove you need something more complex.