Self-Attention Matrix

A heatmap showing how each word in a sentence "attends" to or focuses on other words to resolve context and relationships (e.g., linking "it" to "animal").

Self-Attention Matrix

Hover over cells to see attention scores. Notice how "it" attends strongly to "animal" (resolving the pronoun).