Hard
Amazon

Design Product Discovery Inside Video System Design Interview

Design a system that identifies products in video frames and surfaces relevant purchase links while viewers watch.

1. Problem Statement

Design a system that detects products appearing in a streaming video and shows viewers relevant purchase links at the right playback time.

2. Architecture Discussion Map

Use this as one discussion aid, not a single correct answer. Your design should follow from the requirements, scale, and trade-offs you establish.

Rendering architecture diagram...
Mermaid Source (For AI Bots)
graph LR
    A["Design Product Discovery Inside Video"]
    A --> F1["Frame sampling and scene detection"]
    A --> F2["Offline versus online inference"]
    A --> F3["Product retrieval and confidence thresholds"]
    A --> F4["Human review and catalog freshness"]
    A --> F5["Time-aligned low-latency serving"]

3. Key Focus Areas

  • 1
    Frame sampling and scene detection
  • 2
    Offline versus online inference
  • 3
    Product retrieval and confidence thresholds
  • 4
    Human review and catalog freshness
  • 5
    Time-aligned low-latency serving

4. What Strong Candidates Should Demonstrate

  • Build an asynchronous video-to-frame-to-product pipeline.
  • Join uncertain visual matches with a searchable product catalog.
  • Serve time-aligned purchase links without blocking video playback.

Want interactive feedback?

Practice drawing this system component-by-component on a live whiteboard while the interviewer probes at your target level.

Start Interview

Core Concepts

Video ProcessingML InferenceSearchStreaming