Envoy Proxy Architecture
What You'll Learn
You'll discover how Envoy's modern, cloud-native proxy design differs from traditional load balancers like NGINX or HAProxy.
Core Idea
Envoy is an open-source, high-performance proxy designed for microservices and service mesh architectures. Unlike traditional load balancers configured with static files, Envoy embraces dynamic configuration — it can update routing rules, health checks, and load balancing algorithms on-the-fly without restarts.
Think of traditional load balancers as vending machines with fixed buttons: to change what's inside, you must stop the machine and rewire it. Envoy is like a smart vending machine that updates its menu and inventory instantly through a control system, without going offline.
Key Architectural Features
Dynamic Configuration via APIs: Envoy's xDS (discovery service) APIs allow a central control plane to push configuration changes in real-time. Add a new server? Envoy learns about it immediately.
Built-in Observability: Envoy generates detailed metrics, logs, and distributed traces out-of-the-box. Every request produces statistics about latency, success rates, and traffic patterns — crucial for diagnosing issues in complex systems.
Service Mesh Foundation: Envoy runs as a sidecar proxy alongside each microservice instance. It handles all network traffic for that service, enforcing routing rules, retries, timeouts, and circuit breaking without requiring code changes in your application.
Modern Protocol Support: Layer 7 load balancing for HTTP/2, gRPC, and WebSocket connections, plus advanced features like automatic retries and traffic shadowing.
Real-World Context
Companies like Lyft (Envoy's creator), Airbnb, and Netflix use Envoy to manage thousands of microservices. Tools like Istio and AWS App Mesh use Envoy as their data plane proxy.
Key Takeaway: Envoy is a dynamic, observable proxy designed for modern microservices, enabling real-time configuration updates and rich telemetry that traditional load balancers can't easily provide.