the
∞
.ai
Search
/
Concepts
trail ·
0 nodes
Every concept
Platform
8 concepts, 8 reviewed and merged.
Data
Data Versioning
Being able to name the exact data a run used, and get it back.
verified
Feature Store
One place where a feature is defined, computed, stored and served — so that the thing a model trains on and the thing…
verified
Foundations
Training-Serving Skew
A feature computed one way when the model was trained and another way when it is served.
verified
Practice
Experiment Tracking
Recording what was run, with what code, on what data, and what came out — automatically, at the moment it happens.
verified
Online Learning
Update the model as data arrives, rather than retraining on a corpus every so often.
verified
Serving
Batch Inference
Score a large set of inputs offline, with nobody waiting.
verified
Disaggregated Serving
Run the two halves of generation on separate machines.
verified
Systems
Offload
Keep part of the model somewhere cheaper than the accelerator — host memory, or an SSD — and move it in when it is…
verified