Observability

Observability

OpenTelemetry, Prometheus at scale, SLOs, eBPF, alert fatigue.

66Articles
66Topics covered
Articles in this category

All 66 articles, sorted alphabetically

Advertisement
ARTICLE · 01

Alert Fatigue Solutions

Alert correlation deduplication and on-call rotation health.

Read article
ARTICLE · 02

Alerting Best Practices

SLO-based alerts. Multi-window multi-burn-rate. Reduce noise.

Read article
ARTICLE · 03

Alerting That Doesn't Burn Out Oncall

Symptom-based, multi-window, and ruthlessly pruned.

Read article
ARTICLE · 04

Chaos Engineering + Observability

Chaos requires observability to be safe. Together they build resilience.

Read article
ARTICLE · 05

Distributed Tracing Deep Dive

Trace context propagation. Sampling. Real-world debugging.

Read article
ARTICLE · 06

Distributed Tracing with Jaeger

Sampling propagation and root-cause analysis.

Read article
ARTICLE · 07

eBPF Observability in 2026

Pixie Parca Cilium Hubble and what they reveal.

Read article
ARTICLE · 08

Golden Signals Revisited

RED USE and the 2026 picture.

Read article
ARTICLE · 09

Grafana

Data source federation. Loki + Tempo. Grafana Cloud + Alloy.

Read article
ARTICLE · 10

Structured Logging Best Practices

JSON logs. Correlation IDs. Levels + PII redaction.

Read article
ARTICLE · 11

Loki vs Elastic vs ClickHouse for Logs

Cost, query speed, and the cardinality story.

Read article
ARTICLE · 12

Metric Cardinality

Labels explode. Prometheus cardinality kills. Best practices.

Read article
ARTICLE · 13

Metric Cardinality Management

Why your bill exploded and how to fix it.

Read article
ARTICLE · 14

Adaptive trace sampling architecture

Deep-dive on adaptive sampling for distributed tracing: why fixed-rate sampling fails, a rate governor that measures per-operation throughput and allo…

Read article
ARTICLE · 15

Alerting

How to design alerts that page humans only when action is needed, avoiding alert fatigue.

Read article
ARTICLE · 16

Alerting architecture

Deep-dive on alerting: signal, rules, alertmanager, routing, oncall schedule, escalation, burn-rate, silence + inhibit, runbook.

Read article
ARTICLE · 17

Metrics anomaly detection architecture

Deep-dive on anomaly detection for metrics at scale: series routing and windowing, seasonal baseline stores, cheap detector ensembles with persistence…

Read article
ARTICLE · 18

Burn-rate SLO alerting architecture

Deep-dive on multi-window multi-burn-rate SLO alerting: why a burn rate (observed error ratio divided by the budget the SLO permits) turns an alert in…

Read article
ARTICLE · 19

Metric cardinality -- the silent cost driver of observability

Deep-dive on metric cardinality: every label combination as a distinct time series, cardinality as the product of label value counts, explosions from …

Read article
ARTICLE · 20

Dashboards-as-code architecture

Deep-dive on building observability dashboards as versioned code: shared panel and query libraries for consistency, CI validation that catches broken …

Read article
ARTICLE · 21

eBPF Observability Architecture in Depth

A 2500-word walkthrough of eBPF observability: user app, kernel attach points, verifier + JIT, maps, network/syscall/user probes, aggregator, export.

Read article
ARTICLE · 22

Metrics exemplars architecture

Deep-dive on metrics exemplars: attach trace IDs to metric points, storage, query UI, sampling, cardinality, retention alignment.

Read article
ARTICLE · 23

Full-Stack Observability Architecture in Depth

A 2500-word walkthrough of a modern observability stack: OTel, collector, metrics/traces/logs/profiles/eBPF, alerting, dashboards, and on-call.

Read article
ARTICLE · 24

Grafana

How Grafana visualizes metrics from Prometheus, InfluxDB, CloudWatch, and other sources into unified dashboards.

Read article
ARTICLE · 25

Head-based trace sampling architecture

Deep-dive on head-based sampling for distributed tracing: the root-span sampling decision, the sampled flag in propagated trace context, consistent tr…

Read article
ARTICLE · 26

Health check architecture

Deep-dive on health checking: why liveness, readiness, and startup probes ask different questions, shallow vs deep checks, how a shared /health endpoi…

Read article
ARTICLE · 27

Latency histograms and quantile estimation architecture

Deep-dive on latency histograms: hot-path bucket counters, why percentiles don't average, cumulative buckets and mergeability…

Read article
ARTICLE · 28

Jaeger

How Jaeger collects, stores, and visualizes distributed traces at scale.

Read article
ARTICLE · 29

Logs

How structured logging works, log levels, and centralized aggregation via ELK, Loki, or Cloud Logging.

Read article
ARTICLE · 30

Logs architecture

Deep-dive on logs pipeline: structured logging, shippers, aggregators, storage, schema, correlation, redaction, retention.

Read article
ARTICLE · 31

Metric downsampling architecture

Deep-dive on metric downsampling: why lossy aggregation must preserve the extremes incidents live in, the tiered storage model and cascading rollups, …

Read article
ARTICLE · 32

Metrics

How metrics work: counters, gauges, histograms, and dimensional cardinality.

Read article
ARTICLE · 33

Metrics architecture

Deep-dive on metrics architecture: instrumentation, TSDB, counters/gauges/histograms, cardinality budgets, recording rules, alerts.

Read article
ARTICLE · 34

OpenTelemetry

How OpenTelemetry unifies collection of metrics, logs, and traces via a vendor-neutral standard.

Read article
ARTICLE · 35

OpenTelemetry Collector architecture

Deep-dive on the OTel Collector: receiver/processor/exporter pipelines and connectors, daemonset agents vs gateway fleets, trace-affinity tail samplin…

Read article
ARTICLE · 36

Continuous profiling architecture

Deep-dive on continuous profiling: async-profiler/pprof, sampling, storage, flame graphs, diff, CPU/heap/lock, correlation.

Read article
ARTICLE · 37

Prometheus

How Prometheus provides pull-based metrics collection, PromQL query language, and integration with Alertmanager.

Read article
ARTICLE · 38

Recording rules architecture

Deep-dive on monitoring recording rules: evaluating expensive queries on a fixed interval and storing results as cheap derived series, the rule evalua…

Read article
ARTICLE · 39

Real User Monitoring

Deep-dive on Real User Monitoring: browser SDK instrumentation, Core Web Vitals (LCP/INP/CLS), session and error tracking, beacon transport, field vs …

Read article
ARTICLE · 40

OpenTelemetry semantic conventions architecture

Deep-dive on OpenTelemetry semantic conventions, the standardized registry of attribute names, types, and values that makes telemetry correlatable acr…

Read article
ARTICLE · 41

SLO Engineering Architecture in Depth

A 2500-word walkthrough of SLO engineering: user journey, SLI, SLO, error budget, burn rate alerts, SLO store, ownership, policy, postmortem.

Read article
ARTICLE · 42

SLOs and SLIs

How Service Level Objectives (SLOs) formalize reliability targets, and how Service Level Indicators (SLIs) measure them.

Read article
ARTICLE · 43

SLO architecture

Deep-dive on SLOs: SLI, target, error budget, burn rate, fast + slow alerts, windowed measurement, enforcement, postmortem.

Read article
ARTICLE · 44

Span links architecture

Deep-dive on span links: parent vs follows_from, batch consumer correlation, link attributes, sampling, backend support.

Read article
ARTICLE · 45

Span metrics architecture

Deep-dive on span metrics: the OTel Collector spanmetrics connector, RED metrics (rate/errors/duration) with dimensions, exemplars linking metrics to …

Read article
ARTICLE · 46

Synthetic monitoring -- testing from the outside, always

Deep-dive on synthetic monitoring: proactive scripted probes (uptime, API, browser flows), running from many locations, the comparison to real user mo…

Read article
ARTICLE · 47

Tail-based trace sampling architecture

Deep-dive on tail-based sampling: why head sampling loses incident evidence, trace-ID-aware load balancing, decision buffers and windows, keep policie…

Read article
ARTICLE · 48

The Three Pillars of Observability

The three pillars framework and how each provides different visibility into system behavior.

Read article
ARTICLE · 49

Trace context propagation architecture

Deep-dive on distributed trace context propagation: the W3C traceparent wire format, inject/extract at every boundary, parent/child span linkage, bagg…

Read article
ARTICLE · 50

Distributed Traces

How distributed traces link operations across services via trace context propagation.

Read article
ARTICLE · 51

Distributed tracing architecture

Deep-dive on distributed tracing: spans, W3C context propagation, head + tail sampling, OTel Collector, storage, and correlation with logs and metrics…

Read article
ARTICLE · 52

Observability

The three pillars. What each is for + when to use.

Read article
ARTICLE · 53

On-Call Runbooks

Every alert has a runbook. Live document. Actual practice.

Read article
ARTICLE · 54

OpenTelemetry

Vendor-neutral instrumentation. Trace + metric + log signals.

Read article
ARTICLE · 55

OpenTelemetry Full Stack

Instrumentation collectors and backend choices.

Read article
ARTICLE · 56

OpenTelemetry Pipeline Design

Collectors, sampling, and the cost-versus-fidelity trade.

Read article
ARTICLE · 57

Blameless Postmortem Culture

Learn from incidents without blame. Structured process.

Read article
ARTICLE · 58

Continuous Profiling in Production

Pyroscope, Parca, and the new always-on profiling.

Read article
ARTICLE · 59

Prometheus at Scale

Long-term storage and HA strategies for Prometheus.

Read article
ARTICLE · 60

Prometheus

Pull-based metrics. TSDB. PromQL. Alerting.

Read article
ARTICLE · 61

RED Method vs USE Method

Two complementary frameworks for service metrics.

Read article
ARTICLE · 62

SLIs, SLOs, and Error Budgets

From the textbook to a practice teams actually use.

Read article
ARTICLE · 63

SLI SLO SLA Explained

Defining and measuring reliability budgets.

Read article
ARTICLE · 64

SLOs, SLIs, Error Budgets

Google SRE practice. Set targets. Trade reliability + velocity.

Read article
ARTICLE · 65

Structured Logging Best Practices

JSON logs trace correlation and PII scrubbing.

Read article
ARTICLE · 66

Trace Sampling Strategies Deep Dive

Head tail and adaptive — picking by use case.

Read article