Why it matters

Selectivity enables SSM to match attention capability. Understanding shapes Mamba.

Advertisement

The architecture

Compute A, B, C from input at each timestep.

No conv form; requires scan.

Selective SSM structureInput x(t)sequence elementCompute A, B, Cinput-dependentUpdate statewith selective ATrades conv-form efficiency for adaptivity; scan kernel critical
Selective SSM.
Advertisement

How it works end to end

Loss of convolutional form.

Parallel scan implementation.

Hardware-aware kernel (Mamba's contribution).