← Lessons

quiz vs the machine

Silver1050

Machine Learning

The ML System Design Framework

A repeatable structure for answering open-ended ML design questions under pressure.

5 min read · intro · beat Silver to climb

Why a framework

ML design questions are deliberately vague. A framework keeps you from jumping straight to model architecture and forgetting the parts that actually decide success in production.

The stages

Work top to bottom, narrating trade-offs as you go.

  • Clarify the business goal, scale, and constraints before anything else
  • Frame the problem as a concrete ML task with inputs and outputs
  • Metrics for both the model and the business
  • Data sources, labels, and freshness
  • Model baseline first, then complexity only if justified
  • Serving latency, throughput, batch versus real time
  • Evaluation offline and online, including an AB test
  • Monitoring drift, failures, and feedback loops

Use a baseline anchor

Always propose a simple baseline first. A heuristic or logistic regression gives you a number to beat and a fallback for launch day.

The order matters: each stage feeds constraints into the next. A latency budget set early eliminates whole classes of models later.

Key idea

Lead with the problem and the metric, not the model. A framework turns a vague prompt into a defensible, ordered argument.

Check yourself

Answer to earn rating on the learn ladder.

1. What should you establish before choosing a model architecture?

2. Why propose a simple baseline early?