Course contentsShow
← System Design
Lesson 115 of 1,9193. Load BalancingFree lesson

Envoy Proxy Architecture

Learn Envoy's modern proxy design, dynamic configuration, observability features, and role in service meshes.

Envoy Proxy Architecture

What You'll Learn

You'll discover how Envoy's modern, cloud-native proxy design differs from traditional load balancers like NGINX or HAProxy.

Core Idea

Envoy is an open-source, high-performance proxy designed for microservices and service mesh architectures. Unlike traditional load balancers configured with static files, Envoy embraces dynamic configuration — it can update routing rules, health checks, and load balancing algorithms on-the-fly without restarts.

Think of traditional load balancers as vending machines with fixed buttons: to change what's inside, you must stop the machine and rewire it. Envoy is like a smart vending machine that updates its menu and inventory instantly through a control system, without going offline.

Key Architectural Features

Dynamic Configuration via APIs: Envoy's xDS (discovery service) APIs allow a central control plane to push configuration changes in real-time. Add a new server? Envoy learns about it immediately.

Built-in Observability: Envoy generates detailed metrics, logs, and distributed traces out-of-the-box. Every request produces statistics about latency, success rates, and traffic patterns — crucial for diagnosing issues in complex systems.

Service Mesh Foundation: Envoy runs as a sidecar proxy alongside each microservice instance. It handles all network traffic for that service, enforcing routing rules, retries, timeouts, and circuit breaking without requiring code changes in your application.

Modern Protocol Support: Layer 7 load balancing for HTTP/2, gRPC, and WebSocket connections, plus advanced features like automatic retries and traffic shadowing.

Real-World Context

Companies like Lyft (Envoy's creator), Airbnb, and Netflix use Envoy to manage thousands of microservices. Tools like Istio and AWS App Mesh use Envoy as their data plane proxy.

Key Takeaway: Envoy is a dynamic, observable proxy designed for modern microservices, enabling real-time configuration updates and rich telemetry that traditional load balancers can't easily provide.