Average latency hides the tail. A service with avg 100ms and p99 of 2000ms means 1% of users wait 20× as long as average. Often the 1% is your biggest, most-engaged users.
Track p50/p95/p99/p999. SLOs almost always set on tail percentiles, not averages.