Why it matters

Mamba SSMs offer linear scaling. Compete with transformers at some scales.

Advertisement

The architecture

SSM with selective A, B, C.

Parallel scan training.

Linear inference.

Mamba SSM mathSelective SSMA, B, C, ΔParallel scantrainingLinear inferenceno KV cacheGu-Dao 2023; Mamba-2 (2024) further improvements; hybrid Mamba-attention popular
Mamba SSM math.
Advertisement

How it works end to end

Gu-Dao 2023 Mamba.

Mamba-2 improvements.

Hybrid Mamba-attention.