System design interview question · ML & AI

Design an ML model monitoring system

Notice when a production model becomes slow, biased, or less useful.

Intermediate 40 minutesModel quality Plus
More ML & AI questions

Concepts this round covers

  • Delayed ground truth
  • Drift metrics
  • Privacy-preserving telemetry
  • Model quality

This is a Plus round

The brief, the scale to design for, the questions interviewers ask and the common mistakes for this round are available to Plus members. Plus is coming soon.