Course contentsShow
← System Design
Lesson 676 of 1,91918. Message Queues and BrokersFree lesson

Choosing Between Message Broker Technologies

Decision matrix comparing throughput, guarantees, operational complexity, and cloud vs self-hosted.

Choosing Between Message Broker Technologies

You'll learn: How to systematically compare message brokers using a decision matrix of throughput, delivery guarantees, operational complexity, and deployment models.

The Selection Challenge

Choosing the right message broker isn't about picking the "best" technology—it's about matching requirements to strengths. You've now seen RabbitMQ, SQS, SNS, Redis, NATS, and cloud-managed services. Each excels in different scenarios, and the wrong choice creates operational headaches down the line.

The Decision Matrix

Think of broker selection like choosing a vehicle: a sports car, pickup truck, and minivan all move people, but each suits different needs.

Throughput Requirements

  • High-volume streaming: Kafka (covered later), NATS
  • Moderate throughput: RabbitMQ, ActiveMQ
  • Lightweight tasks: Redis, SQS

Delivery Guarantees

  • At-least-once with durability: RabbitMQ, SQS, Azure Service Bus
  • At-most-once (fast, lossy): Redis pub/sub, basic NATS
  • Exactly-once semantics: Specialized brokers with transactional support

Operational Complexity

  • Managed/serverless (zero ops): SQS, SNS, Google Cloud Pub/Sub, Azure Service Bus
  • Moderate complexity: RabbitMQ clusters, Redis
  • Higher complexity: Self-hosted ActiveMQ, multi-datacenter setups

Cloud vs Self-Hosted

  • Cloud-native: Use managed services (SQS/SNS, GCP Pub/Sub) for lower operational burden
  • Self-hosted: RabbitMQ, NATS, Redis when you need control or hybrid deployments
  • Hybrid: Azure Service Bus, which offers both

Making the Decision

Start with these questions: Do you need guaranteed delivery or can you tolerate message loss? Is operational simplicity worth vendor lock-in? What's your throughput ceiling? Does your team have expertise with specific brokers?

Key Takeaway: Choose message brokers by mapping your requirements (throughput, guarantees, ops expertise) against each technology's strengths—there's no universal "best" choice, only the right fit for your constraints.