Reliability

  • Health/liveness/readiness probes ✓
  • Graceful shutdown ✓
  • Retries + circuit breakers ✓
  • Timeout per LLM call + tool ✓
  • Rate limiting per user ✓
Advertisement

Observability

  • Structured logs with correlation IDs ✓
  • Metrics: latency, errors, cost per call ✓
  • Traces via OTel ✓
  • Dashboards + alerts ✓
  • SLO defined ✓
Advertisement

Safety

  • Input filtering ✓
  • Output filtering ✓
  • PII redaction ✓
  • Tool authz ✓
  • Prompt injection defenses ✓