Alert Quality Metrics
What you'll learn: You'll master the three core metrics that measure how effectively your detection rules separate real threats from noise.
Understanding Detection Accuracy
When your SIEM fires an alert, it's making a prediction: "This might be an attack." But how good are those predictions? Alert quality metrics answer that question by measuring the accuracy of your detection content. These metrics tell you whether you're catching real threats, drowning in false alarms, or both.
The Three Essential Metrics
True Positive Rate (TPR) — Also called "detection rate," this measures what percentage of actual security incidents your alerts successfully caught. If 100 real attacks occurred and you detected 85, your TPR is 85%. Higher is better; this is your "hit rate."
False Positive Rate (FPR) — This measures how often alerts fire incorrectly. If you get 100 alerts and 80 aren't real incidents, your FPR is 80%. Lower is better; high FPR causes alert fatigue and wastes analyst time.
Alert-to-Incident Ratio — This compares total alerts generated to actual confirmed incidents. If you receive 1,000 alerts but only 50 become incidents, your ratio is 20:1. Lower ratios mean better signal-to-noise. World-class SOCs aim for ratios below 10:1, while immature programs often suffer ratios exceeding 100:1.
Why This Matters
Think of these metrics like a smoke detector: TPR tells you if it catches real fires, FPR tells you how often it blares when you're just cooking toast, and the ratio tells you the overall trust you can place in it. You want high TPR (catch threats) with low FPR (minimize noise) to create a sustainable detection program.
Track these metrics per rule, per data source, and across your entire detection stack to identify tuning opportunities and measure improvement over time.
Key Takeaway: True positive rate, false positive rate, and alert-to-incident ratio are the fundamental measurements of detection quality—high TPR catches threats, low FPR reduces noise, and improving the ratio creates a sustainable SOC operation.