Transformer Internals, Made Visible
Attention Vortex
Watch four live attention heads pull sentences into a glowing field of arcs, then click any word to
isolate exactly what the model is reading.
Active viewAll heads
Tokens6
Dominant linkcat → sat
Head Roles
Head 0: syntax
Head 1: semantics
Head 2: spatial
Head 3: context