Course contentsShow
← AI Engineering
Lesson 991 of 1,88624. Building AI APIsFree lesson

Quota Management and Billing

Tracking token usage, API calls, and enforcing monthly quotas tied to billing plans.

Quota Management and Billing

What You'll Learn

You'll learn how to track token usage and API calls, then enforce monthly quotas tied to different billing plans.

Why This Matters

Rate limiting prevents abuse in the moment, but quota management tracks cumulative usage over time. Think of it like a monthly cell phone plan: rate limiting prevents you from making 100 calls simultaneously, while quota management ensures you don't exceed your 500-minute monthly allowance.

Core Concepts

Tracking Usage: Every API request needs to log:

  • Tokens consumed (prompt + completion)
  • API call count
  • Associated user/API key
  • Timestamp

Quota Enforcement: Before processing a request, check if the user has quota remaining:

if user.tokens_used_this_month >= user.plan.token_limit:
    raise QuotaExceededError("Monthly token limit reached")

Billing Plan Tiers: Different plans offer different limits:

  • Free: 10K tokens/month
  • Starter: 100K tokens/month, $20
  • Pro: 1M tokens/month, $150

Implementation Pattern:

  1. Increment usage counters in Redis (fast writes)
  2. Periodically sync to database (durable storage)
  3. Reset counters at billing cycle start
  4. Send warnings at 80% and 100% quota

Grace Periods: Consider soft limits that warn users before hard-blocking them, allowing time to upgrade.

Key Takeaway

Quota management transforms rate limiting from "requests per second" to "cumulative usage per billing period," enabling sustainable monetization while protecting infrastructure from unlimited consumption.