AI Grimoire
05 — siblings
features/circuits/causal/
probing/

Interpretability / probing

Probing

Train a small classifier on intermediate activations and see what it can recover. It is the oldest tool here and the easiest to over-read: a probe finding information does not establish that the model uses it.

1 entry.

Entries

05.04.1
Logit Lenscommon
Project intermediate residual states through the unembedding matrix.
O(d·V)