Why it matters
Mamba SSMs offer linear scaling. Compete with transformers at some scales.
Advertisement
The architecture
SSM with selective A, B, C.
Parallel scan training.
Linear inference.
Advertisement
How it works end to end
Gu-Dao 2023 Mamba.
Mamba-2 improvements.
Hybrid Mamba-attention.