← Back to the lecture

Explore a trained ViT, one example at a time

Gold compares patch features. Teal shows attention weights. Choose Next example to follow the nine-step tour.

Trained ViT · choose a patch to explore

1 · Locate the purple patch

The Newfoundland photograph, divided into 196 patches

2 · Where does this query read?

Source patches with a measured heatmap
Saved pretrained ViT-Tiny · 224×224 RGB · 14×14 patches · 16×16 pixels per selection · Newfoundland: 95.73%
Explore a trained ViT, one example at a time1 · Choose a query patch2 · Follow its attention weightsP74 · the dog’s left-side ear patchTeal: 0 → 10.35% weightSaved trained-model exampleBlock 4 · Head 1 · Query P74P74: 10.35%P60: 9.09%P49: 6.05%CLS source: 2.09%All 197 source weights sum to 100%. The whole image is available; no causal mask.