Design a Rate Limiter System Design Interview

1. Problem Statement

2. Architecture Discussion Map

Use this as one discussion aid, not a single correct answer. Your design should follow from the requirements, scale, and trade-offs you establish.

graph TD
    A[Client] --> B(Route53 / Global LB)
    B --> C[API Gateway Node 1]
    B --> D[API Gateway Node 2]
    C -- Local L1 Cache --> E[(Caffeine/Guava)]
    C -- Async Lua Script --> F[(Redis Sharded Cluster)]
    D -- Async Lua Script --> F

3. Key Focus Areas

• 1
  Rate Limiting Algorithms (Token Bucket vs Fixed/Sliding Window)
• 2
  Distributed State Management (Redis vs Memcached)
• 3
  Race Conditions (Read-Modify-Write issues)
• 4
  Performance (Latency overhead < 5ms)
• 5
  Placement (Client vs Middleware vs API Gateway)