Spot Instance Fleet Management
What you'll learn: How to architect resilient, cost-optimized workloads using diversified spot instance fleets that minimize interruption impact.
Core Concept
Spot instances offer 50-90% cost savings over on-demand pricing, but cloud providers can reclaim them with minimal notice. Spot Instance Fleet Management means using multiple instance types across availability zones to create a diversified portfolio that reduces interruption risk while maximizing savings.
Think of it like investing: putting all your money in one volatile stock is risky, but spreading across many reduces your exposure to any single failure.
Diversification Strategy
Instead of requesting one instance type (e.g., only c5.large), request a fleet with flexible options:
- Instance type diversity: Include 5-10 similar instance types (
c5.large,c5a.large,c6i.large) - Size flexibility: Mix instance sizes with equivalent capacity (
c5.xlarge= 2xc5.large) - AZ spreading: Distribute across all availability zones in your region
This dramatically reduces interruption probability because spot prices and availability vary independently across types and zones.
Stateless Workload Suitability
Spot fleets work best for:
- Batch processing jobs
- Containerized microservices with multiple replicas
- CI/CD build agents
- Data processing pipelines
- Web servers behind load balancers
The key requirement: workloads must tolerate instance termination gracefully, with work either checkpointed or easily redistributed.
Allocation Strategies
- Capacity-optimized: Prioritizes pools with deepest capacity (lowest interruption likelihood)
- Price-capacity-optimized: Balances cost and interruption risk
- Lowest-price: Cheapest option but higher interruption risk
Modern best practice: capacity-optimized allocation for production stateless workloads.
Key Takeaway: Spot instance fleet management uses diversification across instance types and availability zones to achieve massive cost savings with minimal interruption risk for stateless workloads—the FinOps equivalent of "don't put all your eggs in one basket."