the
∞
.ai
Search
/
Concepts
trail ·
0 nodes
Every concept
Deployment
8 concepts, 8 reviewed and merged.
Measurement
Online Experiment
Split live traffic between the current model and the new one, and measure which does better on the thing you actually…
verified
Monitoring
Production Monitoring
The thing that makes monitoring a served model hard is that you usually do not know whether it was right.
verified
Silent Failure
The failures that hurt are the ones that do not raise anything.
verified
Practice
Model Versioning
"Which model produced this prediction?" is a question every deployed system eventually has to answer, usually under…
verified
Regression Suite
A fixed set of cases the model must still get right before a new version ships.
verified
Release
Canary Rollout
Send a small slice of traffic to the new model, watch the metrics, and widen only if nothing goes wrong.
verified
Rollback
The fastest fix for a bad model is the previous one.
verified
Shadow Deployment
Run the new model on real traffic and throw its answers away.
verified