AICASSINDRA · LEARN BY EXPERIMENTING

Transformers labs

Explore the interactive side of AICassindra. Read a topic, test an idea, and follow the results.

Choose a topic, explore the model, and compare what changes. Each experiment explains its assumptions and limitations.

Browse the collection below.

Transformers

Feed-Forward Layer (MLP)

Hidden dimension expansion + activation + projection back.

Interactive lab
Transformers

Mixture of Experts Routing

Router picks K experts per token. See activation patterns.

Interactive lab
Transformers

Multi-Head Attention

See how heads specialize on different patterns.

Interactive lab
Transformers

Positional Encoding — Sinusoidal vs RoPE

Two ways to inject position information.

Interactive lab