Quiz: can you identify these four classic attention patterns?
cneuralnetwork · x · 2026-11-06
A puzzle graphic asks readers to identify four attention patterns: A shows tokens attending only to earlier positions (causal attention), B is fully bidirectional attention, C connects only neighboring tokens (sliding-window/local attention), and D shows block-local attention with cross-block links. A nice way to test knowledge of Transformer attention variants.
More from Fun
- 'PIZZASAURUS': an absurd AI-generated cat vs. chicken pizza meme video — RealBrainRocket · 2026-11-06
- Law professor says Claude deleted a year of lecture notes at lunch — JeremyNguyenPhD · 2026-11-06
- Animating a 15-page Goofy comic with Claude and MiniMax H3 on an 8GB GPU — Oleksandr_G · 2026-11-06
- magpie ships 90+ versions overnight, sparking全自动 coding speculation — sujingshen · 2026-11-06
- Vjeux amazed as AI fails to recognize an obvious chess checkmate — Vjeux · 2026-11-06
- AI image of Bob Dylan as Emperor Palpatine shaking hands with the Pope — docmilanfar · 2026-11-06