Why it matters
Cache key design shapes correctness. Understanding shapes cache safety.
Advertisement
The architecture
Hash: prompt + model + temperature + top-p + tools + tenant + version.
SHA256 stable digest.
Advertisement
How it works end to end
Serialize deterministically (sorted JSON).
Include model + version.
Tenant / user isolation.
Tool set signature.