Why it matters
Mirostat shapes consistent quality. Understanding shapes advanced sampling.
Advertisement
The architecture
Target tau (log-perplexity).
Adjust k dynamically based on prev tokens.
Advertisement
How it works end to end
Basu et al. 2020.
V1 more compute; V2 simpler.
llama.cpp supports.
Tau = 5 typical.