Why it matters
Wrong temperature affects quality + consistency. Understanding shapes appropriate output.
Advertisement
The architecture
Temperature parameter to generate() call.
Low = argmax-like. High = more diverse sampling.
Advertisement
How it works end to end
Also: top_p (nucleus sampling), top_k, repetition_penalty.
Facts / RAG: low temperature to reduce hallucination.
Chat: moderate for engagement.
Creative writing: high.