AI Grimoire
05 — siblings
features/
circuits/
causal/probing/

Interpretability / circuits

Circuits

Occasionally a computation can be followed all the way through: these heads attend here, that writes this to the residual stream, and the behaviour follows. Circuits are the existence proofs that the rest of interpretability argues from.

1 entry.

Entries

05.02.1
Induction Headsstandard
A two-head circuit that completes [A][B]…[A] with [B]; the substrate of in-context learning.
O(L²)