Matryoshka Embeddings

Why it matters

Matryoshka enables adaptive dim. Understanding shapes efficient retrieval.

The architecture

Train to preserve nested structure.

First k dims usable standalone.

Choose k per use case.

How it works end to end

Kusupati et al. 2022 MRL.

OpenAI text-embedding-3 supports.

Nomic + BGE + more implement.

Truncate + normalize.