Why it matters
RWKV offers RNN-inference + transformer-training. Growing community.
Advertisement
The architecture
Linear attention.
RNN-like inference.
Parallel training.
Advertisement
How it works end to end
Peng 2023.
RWKV-6/7 series.
Community-driven.