Why Consensus is Hard
You'll learn why achieving distributed agreement is fundamentally difficult, even when it seems simple.
The Core Challenge
In theory, getting multiple computers to agree on a value sounds straightforward: just send messages and vote, right? In practice, consensus is one of the hardest problems in distributed systems because the environment is inherently unreliable.
Four Fundamental Obstacles
Network Delays
Messages between nodes don't arrive instantly or predictably. You can't tell if a slow response means the network is congested, the message was lost, or the receiving node has crashed. This unbounded delay makes timing-based decisions unreliable.
Node Failures
Nodes can fail at any moment—crash silently, reboot unexpectedly, or behave erratically. Worse, you can't always distinguish between a dead node and one that's just slow to respond. Remember from earlier: perfect failure detection is impossible.
Message Loss
Networks drop packets. A critical "yes" vote might vanish in transit, but the sender thinks it was delivered. You need mechanisms to detect and handle missing messages without creating infinite retries or contradictory states.
Impossibility of Perfect Detection
This is the killer: you cannot reliably distinguish between a crashed node and a slow one in an asynchronous network. If you wait forever for a response, progress halts. If you timeout too early, you might exclude functioning nodes or make decisions based on incomplete information.
The Real Danger
These issues compound. A network partition might split your cluster while nodes on both sides remain healthy. Each side might independently try to make progress, violating safety guarantees. Solving consensus means building algorithms that guarantee correctness despite all these uncertainties happening simultaneously.
Key Takeaway: Consensus is hard because distributed systems combine unbounded network delays, undetectable failures, message loss, and the impossibility of distinguishing slow from crashed nodes—creating an environment where simple agreement protocols break down.