Representation Learning Theory

Why it matters

Representation theory frames DL. Understanding shapes intuition.

The architecture

Representations trade compression vs invariance vs disentanglement.

Self-supervised + contrastive drive modern DL.

How it works end to end

Contrastive: InfoNCE.

Generative: masked or predictive.

Disentanglement: factored features.