Why it matters

Ollama is dev standard for local LLM. Understanding shapes local ops.

Advertisement

The architecture

Ollama server: HTTP API.

Model pull + serve.

Quantized GGUF format.

Custom Modelfile for prompts / params.

Ollama stackOllama serverlocalhost:11434Model pullGGUF from Ollama hubHTTP APIOpenAI-compatibleOpenAI-compatible API allows drop-in replacement in many apps
Ollama.
Advertisement

How it works end to end

ollama pull llama3.2.

OpenAI-compatible endpoint (v1).

Modelfile for customization.

Model registry.