GGUF Quantization Chooser

Pick the right GGUF quant for your RAM. Speed vs quality vs size trade-offs. For llama.cpp / Ollama / LM Studio.

Quantization comparison

Quant Bits Model size KV cache Total needed Quality Speed Fit
Estimates for llama.cpp GGUF quants. Actual size varies ±10%. See GGUF Format Deep Dive.