Interpretability
8 concepts, 8 reviewed and merged.
Circuits
Control
Foundations
Methods
- Activation PatchingTo find out whether a component causes a behaviour, replace its activations with the ones it had on a different input…verified
- Feature AttributionWhich parts of the input were responsible for this output? Attribution methods answer with one number per input…verified
- Probing ClassifierTrain a small classifier on a model's internal activations to predict some property — part of speech, sentiment…verified
- Sparse AutoencoderIf features are packed into a space too small for them, widen the space.verified