Attention control works on single words too: +124% focus, -21% ignore

Sauers_ · x · 2026-11-19

Extending to word-level control, Sauers shows that telling Qwen to "focus your attention on word [W4]" boosts attention to that word by +124%, while "completely ignore" reduces it by -21% (both p<10⁻⁵), with per-layer decomposition again peaking around layer 28 — showing attention control works beyond paragraph granularity.

Related event: Experiments suggest Qwen3-32B has privileged introspective access to its own attention(10 posts)→

Original post →

More from Research

Research channel →