Why it matters

Activation patching tests causality. Understanding shapes interp method.

Advertisement

The architecture

Run clean vs corrupted prompt.

Patch specific activation between.

Measure output logit shift.

Activation patching flowClean + corrupted runssame shapePatch activationswap betweenMeasure logit shiftcausal effectMeng et al. 2022; enables causal circuit discovery
Activation patching.
Advertisement

How it works end to end

Meng et al. (ROME) 2022.

Path patching for finer causal.

TransformerLens + nnsight support.