SqueezeLLM Quantization

Why it matters

SqueezeLLM pushes low bits. Understanding shapes quant frontier.

The architecture

Sensitivity-based clustering (k-means).

Sparse outlier storage.

Dense + sparse combined.

How it works end to end

Non-uniform quantization.

Outliers stored sparse.

Custom kernels needed.

3-4 bit target.