Detect
Alert triggers: cost spike, latency spike, error spike, quality-drop from continuous eval.
Advertisement
Triage
Trace a recent invocation. Which phase failed? LLM? Tool? Retrieval? Look at cost per turn.
Advertisement
Immediate mitigations
Rate-limit the misbehaving agent. Downgrade to a cheaper model. Turn off a specific tool. Feature-flag the whole path off.