Model Drift

Model drift is the silent loss of accuracy that happens when live data stops resembling the data a model was trained on: the world moves, the model stays still.

MLOps & deliverydriftdata driftconcept drift
§ 01DefinitionModel Drift

No jargon, no math

In plain words, what is it?

A model is a frozen photograph of the patterns in its training data. Score it on tomorrow's data and the match is never perfect, but it usually holds. Drift is when it stops holding. There are two flavours. Data drift: the inputs change, like a product catalogue doubling after an acquisition, so the model meets items it never saw. Concept drift: the inputs look the same but the relationship changed, like customers reacting to a price rise. Either way the effect is identical: predictions quietly degrade while the pipeline keeps serving them. You catch it by monitoring two things in production: the statistical shape of incoming data, and outcome metrics once real answers arrive. The remedy is a new training round on recent data, or a rollback. Where it breaks: drift is invisible until you measure outcomes, and by then the damage is done, so monitoring must run continuously.

§ 02How it worksProduction → monitoring → retraining
  1. 01

    Freeze. A model ships as a fixed artefact trained on past data.

  2. 02

    Shift. Live inputs or relationships change over time.

  3. 03

    Monitor. Outcome metrics and input distributions are watched in production.

  4. 04

    Detect. An alert fires when reality drifts away from training.

  5. 05

    Retrain. Fresh data retrains the model and it is redeployed.

§ 04

Want this running in your stack?

We design and ship AI systems with permissions, logs and human approval. It starts with a 30-minute scoping call.