Measuring Exercise Effectiveness
What you'll learn: How to quantify the success of red team vs blue team exercises using concrete metrics that demonstrate both offensive capabilities and defensive improvements.
Running red vs blue team exercises is only valuable if you can measure what you've learned. Without metrics, you're just running expensive drills with no way to track improvement over time or justify the investment.
Core Metrics for Exercise Success
Dwell Time measures how long an adversary (red team) remains undetected in your environment. In real-world breaches, attackers often lurk for weeks or months before detection. Your goal is to shrink this window. If your first exercise shows a 12-day dwell time and your next one shows 3 days, your detection capabilities have improved significantly.
Detection Rates track what percentage of red team techniques were caught by the blue team. Did your SOC identify 2 out of 10 attack stages, or 8 out of 10? Breaking this down by attack phase (reconnaissance, initial access, lateral movement, etc.) reveals specific blind spots. A 20% detection rate is a baseline problem; 70%+ suggests mature defenses.
Defensive Improvements measure tangible changes implemented after the exercise. Count new detection rules deployed, security controls added, playbooks updated, or gaps closed. This demonstrates ROI beyond just finding problems—it shows you're actually fixing them.
The Feedback Loop
These metrics create a continuous improvement cycle. High dwell time + low detection rates = training and tooling gaps. Track these numbers exercise-over-exercise to prove your security posture is strengthening, not stagnating.
Think of it like a sports team reviewing game footage: you need stats (metrics) to know if your practice drills (exercises) are actually making you better at the game (defending against real threats).
Key Takeaway: Effective red vs blue exercises require quantifiable metrics—dwell time, detection rates, and defensive improvements—to demonstrate progress and guide future security investments.