Prompting alone steers Qwen's attention: 'ignore this' cuts attention by 6%

Sauers_ · x · 2026-11-19

Sauers shows Qwen3-32B can metacognitively control its own attention with no injection, only prompting: asking it to ignore a paragraph lowers attention on it (−6%, p<10⁻⁵), while asking it to focus raises attention (+16%, p<10⁻⁵). Charts show "focus on [P1]–[P4]" instructions boost attention on the named paragraph by up to +248% at layer 28. The author argues that detecting and describing attention injections implies privileged introspective access to its own attention.

Related event: Experiments suggest Qwen3-32B has privileged introspective access to its own attention(10 posts)→

Original post →

More from Research

Research channel →