Prompted focus boosts Qwen's paragraph attention +35–69%, ignore drops it 13–16%
Sauers_ · x · 2026-11-19
In Sauers's experiment, telling Qwen3-32B to "focus your attention on paragraph [Pk]" raised attention to that specific paragraph by +35–69% versus baseline, while "completely ignore" reduced it by -13–16%, with the effect targeted to the named paragraph.
More from Research
- FoodTruck Bench, an LLM agent business-sim benchmark, lands on Papers with Code — NielsRogge · 2026-11-19
- MIT reads and steers LLMs' internal physics intuition via hidden-state shifts in Gemma — ProfBuehlerMIT · 2026-11-19
- harness-hub open-sources RL-trained LoRA adapters tuned per agent harness, recipe coming Friday — yb2698 · 2026-11-19
- RL-Trained Hermes LoRA on Qwen3.8-27B Adds +13.7 Pts on SWE-Bench Pro While Using Fewer Tokens — yb2698 · 2026-11-19
- Freenet releases new video on network routing with old-school ML — Sanity · 2026-11-19
- Empire AI creates 120+ early-career research positions in New York, Cornell deadline Dec 15 — dianarycai · 2026-11-19