Glitch Tokens

Why it matters

Glitch tokens are curiosity + attack vector. Understanding shapes robustness.

The architecture

Under-trained tokens.

Model behavior unpredictable.

Attacker triggers.

How it works end to end

Discovered by Rumbelow + Watkins 2023.

Cause: token in vocab but rare in training.

Behavior: repetition, hallucination, refusals.