ML System Design Interview Questions: 30 Problems and What They Test
ML system design interview questions asked at Meta, Google, Amazon and startups, grouped by type, with what each tests and a worked answer to study.
These are the machine learning system design interview questions that come up most in ML engineer, applied scientist and data scientist loops at large tech companies and ML-heavy startups. They're grouped into families, because questions in a family share an architecture: once you can design one recommender well, the others are variations. For each question you'll find what it really tests and where to study or practise it. Answer any of them with the seven-step framework.
Ranking and recommendations account for a large share of ML design questions at ad-funded and consumer companies. If your time is short, master the recommendation funnel first, then ads, then integrity.
The question families at a glance
Recommendation and personalisation
| Question | What it tests | Study / practise |
|---|---|---|
| Design YouTube's home page recommendations | Multi-stage funnel, multi-objective ranking, satisfaction vs clicks | Worked answer · Round |
| Design a personalized news feed ranking (Facebook, LinkedIn) | Value model over several actions, integrity, freshness | Worked answer · Round |
| Design People You May Know | Graph candidates, link prediction, batch precompute, privacy | Worked answer · Round |
| Design Netflix or Spotify recommendations | Small catalogue vs huge one, session signals, artwork personalisation | Recommendation systems |
| Design an event or restaurant recommender | Location and time context, cold start, availability | Cold start |
| Design similar listings for a rental marketplace | Item embeddings, two-sided marketplace constraints | Embeddings |
| Design Instagram Explore or TikTok For You | Unconnected content, exploration, fast feedback | Bandits |
| Design push notification ranking | Uplift vs open probability, volume caps, send time, long-term holdouts | Feedback loops · Round |
Search and retrieval
| Question | What it tests | Study / practise |
|---|---|---|
| Design search ranking for an e-commerce site | Query understanding, hybrid retrieval, LTR, position bias | Worked answer · Round |
| Design YouTube video search | Text plus engagement signals, multimodal content understanding | Learning to rank |
| Design a visual search system (image to similar images) | Contrastive embeddings, ANN at billions of vectors | Worked answer · Round |
| Design search autocomplete | Prefix retrieval, ranking suggestions, latency | Typeahead · Round |
| Design local business search for a maps app | Distance and opening hours as features, relevance labels | Search ranking |
Ads
| Question | What it tests | Study / practise |
|---|---|---|
| Design ad click prediction for a social platform | Calibration, sparse features, auction, frequent retraining | Worked answer · Round |
| Design ads ranking with conversion optimisation | Delayed labels, multi-task click and conversion models | Continual learning |
| Design an ad targeting / lookalike audience system | User embeddings, similarity search, privacy | Embeddings |
| Design an ad click aggregator (data side) | Streaming counts, deduplication, exactly-once | Round |
Integrity, trust and safety
| Question | What it tests | Study / practise |
|---|---|---|
| Design real-time payment fraud detection | Imbalanced and delayed labels, velocity features, cost thresholds | Worked answer · Round |
| Design harmful content detection | Multimodal multilabel models, review queues, prevalence | Worked answer · Round |
| Design spam or fake account detection | Behaviour and graph signals, adversaries | Feedback loops |
| Design blurring of faces and plates in street imagery | Object detection at scale, precision vs recall, batch pipelines | Model serving |
Prediction and forecasting
| Question | What it tests | Study / practise |
|---|---|---|
| Design ETA prediction for food delivery or rides | Stage decomposition, quantiles, real-time features | Worked answer · Round |
| Design dynamic (surge) pricing | Demand and supply forecasting, feedback effects, experiments | A/B testing · Round |
| Design demand forecasting for inventory | Time-series features, hierarchy, backtesting | Training data |
| Design churn prediction and intervention | Label definition, uplift vs propensity, actioning | Problem framing |
ML infrastructure and platforms
| Question | What it tests | Study / practise |
|---|---|---|
| Design a feature store | Point-in-time joins, online/offline parity, streaming features | Guide · Round |
| Design a distributed training platform | GPU scheduling, checkpointing, reproducibility | Guide · Round |
| Design a low-latency model serving platform | Batching, autoscaling, canaries, multi-model hosting | Guide · Round |
| Design an ML model monitoring system | Drift, delayed labels, alerting | Guide · Round |
| Design an ML platform for many teams | Self-service workflow, registry, governance, cost | Guide |
| Design an experimentation platform | Assignment, metrics pipelines, guardrails | Guide · Round |
Generative AI questions
Questions like "design ChatGPT", "design a RAG chatbot" or "design a customer support agent" are increasingly common, especially for AI engineer roles. They need a different framework; see generative AI system design interview questions and the AI engineer roadmap.
How to practise these
- Read one worked answer per family, then close it and redraw the architecture from memory.
- For a second question in the same family, write only what changes: label, features, metric, serving constraint.
- Do timed rounds out loud: 45 minutes, framework steps in order, with someone (or an AI interviewer) asking follow-ups.
- After each round, list the questions you couldn't answer and read the matching guide on the ML roadmap.
Frequently asked questions
What are the most common ML system design interview questions?
Design a video or feed recommendation system, ad click prediction, search ranking, fraud detection, harmful content detection, People You May Know, visual search, ETA prediction, and ML infrastructure such as a feature store or model serving platform.
How should I prepare for ML system design questions?
Study one worked answer per question family (recommendations, search, ads, integrity, prediction, platforms), redraw each from memory, then do timed practice rounds using a seven-step framework.
Further reading
- Machine Learning System Design InterviewAli Aminian and Alex Xu, ByteByteGo
- Designing Machine Learning SystemsChip Huyen, O'Reilly