Qwen3-32B can name which paragraph it attended to most — above chance, no injection needed

Sauers_ · x · 2026-11-19

In follow-up experiments, Sauers shows Qwen3-32B can identify which paragraph it naturally attended to most — without any injection — either self-reporting in the same chat or judging from just reading the transcript.

Chart data: rank correlation between self-report and true attention is 0.42 (p<10⁻⁵); 0.49 when a second instance reads the transcript, with 96% top-1 accuracy on the correct paragraph. The ability to control attention peaks sharply at early-mid layers, near zero in early layers.

Related event: Experiments suggest Qwen3-32B has privileged introspective access to its own attention(10 posts)→

Original post →

More from Research

Research channel →