Multimodal Scaling

Why it matters

Multimodal scaling shapes MLLM. Understanding shapes design.

The architecture

Modality mix in training.

Encoder + adapter + LLM staging.

Curriculum: text first, then multimodal.

How it works end to end

Encoder pretrained (CLIP, SigLIP, Whisper).

Adapter cheap; LLM optional freeze.

Curriculum + mixing.