Why it matters
EAGLE improves accept rate vs Medusa. Higher throughput for same architecture.
Advertisement
The architecture
Predict from features not tokens.
Tree draft.
Higher accept rate.
Advertisement
How it works end to end
Li et al. 2024.
Feature-based draft.
Larger tree.