Course contentsShow
← System Design
Lesson 1091 of 1,91928. Timeouts and DeadlinesFree lesson

Default Timeout Pitfalls

Why relying on library defaults or infinite timeouts is dangerous and how to choose appropriate values.

Default Timeout Pitfalls

You'll learn why blindly trusting library defaults or infinite timeouts leads to cascading failures and performance disasters.

Why Library Defaults Are Dangerous

Most HTTP clients, database drivers, and RPC libraries ship with default timeout values — or worse, no timeout at all (infinite wait). These defaults are designed to be permissive and "just work" in simple scenarios, not to protect production systems under load.

The problem: A default timeout of 60 seconds might seem reasonable in isolation, but when you have 100 concurrent requests each waiting 60 seconds, you've locked up resources for 6,000 seconds of cumulative time. Meanwhile, users experience frozen interfaces and cascading failures ripple upstream.

The Infinite Wait Trap

Some libraries default to infinite timeouts, meaning a request will wait forever for a response. Think of it like calling a friend who never picks up — you're stuck holding the phone indefinitely while your entire day freezes.

In distributed systems, infinite timeouts guarantee resource exhaustion. Threads, connections, and memory pile up waiting for responses that may never arrive.

How to Choose Appropriate Values

Start with business requirements: What's the maximum acceptable latency for your users? If your SLA promises 200ms responses, your downstream timeout budget must be smaller — perhaps 50-100ms per hop.

Consider the 99th percentile: Don't tune for average latency. If P99 is 500ms, setting a 600ms timeout means 1% of requests still fail slowly.

Test under failure: Simulate downstream delays and measure resource consumption at various timeout values.

Key Takeaway: Default timeouts are rarely production-ready; always set explicit, short timeouts based on actual latency requirements and failure budget, not arbitrary library defaults.