Availability SLO
% of turns that returned any response. 99.5% is aggressive; 99% is normal.
Advertisement
Latency SLO
p95 first-token < 2s for chat. p99 completion < 20s. Different endpoints, different SLOs.
Advertisement
Quality SLO — the hard one
% of turns rated satisfactory by an eval judge (LLM-as-judge or human). Continuous eval loop feeds this.