The Four Golden Signals
What you'll learn: The four essential metrics that form the foundation of any effective distributed system monitoring strategy.
Why These Four Matter
When monitoring complex cloud systems, you could track thousands of metrics. The Four Golden Signals (from Google's Site Reliability Engineering) cut through the noise by focusing on what truly indicates system health. Think of them as your system's vital signs—like pulse, blood pressure, temperature, and breathing for a patient.
The Four Signals
1. Latency
How long does it take to service a request? Track both successful requests and failed ones separately—a fast error is still an error. High latency means users are waiting.
2. Traffic
How much demand is the system handling? Measured in requests per second, transactions, or sessions. This shows if you're experiencing normal load, growth, or an attack.
3. Errors
What percentage of requests are failing? Include explicit failures (HTTP 500s) and implicit ones (correct status code but wrong content). Rising error rates signal immediate problems.
4. Saturation
How "full" is your system? CPU, memory, disk I/O, network bandwidth—when resources approach 100%, performance degrades. This is your early warning system before things break.
Why Start Here
These four signals correlate directly with user experience. If all four are healthy, your users are probably happy. If any signal deteriorates, you know where to investigate rather than drowning in data.
Key Takeaway: Latency, traffic, errors, and saturation provide a complete foundation for monitoring distributed systems—they tell you how fast, how busy, how broken, and how constrained your services are at any moment.