Course contentsShow
← System Design
Lesson 1787 of 1,91943. Real-World System: Rate Limiter ServiceFree lesson

Configuration Model for Rate Limits

Defining rules per resource, user tier, or tenant with flexible time windows and thresholds.

Configuration Model for Rate Limits

What you'll learn: How to design a flexible configuration system that defines rate-limiting rules per resource, user tier, or tenant with customizable time windows and thresholds.

Why Configuration Matters

A rate limiter service needs a configuration model to define who gets limited how much and when. Instead of hard-coding limits, you need a flexible system that lets you set different rules for different scenarios—like allowing premium users more API calls than free users, or giving /search endpoints higher limits than /upload endpoints.

Core Components of the Configuration Model

Resource-Based Rules

Define limits per API endpoint or resource type:

/api/search → 1000 requests per minute
/api/upload → 100 requests per hour

User Tier or Role Rules

Different limits based on customer subscription level:

Free tier → 100 requests/day
Premium tier → 10,000 requests/day
Enterprise → custom limits

Tenant-Based Rules

In multi-tenant systems, each organization gets its own quota:

Tenant_A → 50,000 requests/hour
Tenant_B → 5,000 requests/hour

Flexible Time Windows

Support multiple time window types:

  • Fixed windows (per minute, per hour, per day)
  • Sliding windows (last 60 seconds)
  • Token bucket parameters (capacity + refill rate)

Configuration Schema Example

Your config model might look like:

{
  "rule_id": "premium_search",
  "resource": "/api/search",
  "user_tier": "premium",
  "limit": 5000,
  "window": "60s",
  "algorithm": "sliding_window"
}

This allows administrators to update limits without code changes, enabling quick responses to traffic spikes or abuse.

Key Takeaway: A well-designed configuration model separates rate-limiting policy from implementation, allowing flexible rules per resource, user tier, or tenant with independently adjustable time windows and thresholds—making your rate limiter adaptable to diverse business requirements.