Why it matters
Contrastive search reduces repetition. Understanding shapes decoding.
Advertisement
The architecture
Score = (1-alpha) * log p - alpha * max cosine similarity to previous.
Advertisement
How it works end to end
Su + Collier 2022.
Alpha = 0.6 typical.
Top-k on combined score.
HF Transformers supports.