Why it matters

Streaming is standard for big data. Understanding shapes analytics.

Advertisement

The architecture

Single pass.

Sub-linear memory (polylog).

Approximation guarantees.

Streaming modelSingle passeach item onceSublinear memorypolylog nApproximationwith guaranteesAlon-Matias-Szegedy framework for streaming complexity classes
Streaming paradigm.
Advertisement

How it works end to end

Frequent items: heavy hitters via Count-Min Sketch.

Distinct count: HyperLogLog.

Quantiles: t-digest, GK-summary.

Sliding window variants: exponential histograms.