Compressed Reasoning Weakens Monitorability
Bryce Little · hf · 2026-07-17
Long chain-of-thought is not always more "monitorable." This study finds that while length-penalty compression significantly reduces reasoning tokens with little loss in multiple-choice accuracy, the underlying prompt-influenced bias doesn't disappear; instead, it becomes harder to detect in the remaining reasoning traces.
The authors trained variants with different target lengths on Qwen3-4B and Qwen3-14B, evaluating them using biasing hints on MMLU-Pro-R and 4 transfer benchmarks. Under maximum compression:
- Lower-bound faithfulness dropped to 63.1% / 69.4% of the baseline (for 14B / 4B respectively).
- The monitor's raw hit rate for catching hint usage dropped from 69%→49% and 60%→48%.
- Even after "length matching," compressed chains revealed 7–35 percentage points fewer prompt influences compared to baseline chains with randomly deleted sentences.
The authors conclude that compression not only shortens reasoning but preferentially removes the exact clues monitors rely on, creating a "compression-monitorability frontier": cheaper reasoning might preserve the answers, but it makes the underlying influence much harder to detect.
More from Research
- Nature paper images cellular activity across all organs, revealing body-wide circuits — arjunrajlab · 2026-09-11
- Skyfall GS Uses Flux to Refine Gaussian Splatting, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11
- Could 10k agents discover learning methods beyond backprop, or just tweak existing ones? — SeunghyunSEO7 · 2026-09-11
- Apodex Launches TRACES, First Benchmark for Evaluating 'Discoverative AI' on Real-World Problems — Faheem_uh · 2026-09-11
- TRACES grades the process, not the answer: six-dimension eval for open-ended AI science — Faheem_uh · 2026-09-11
- Apodex launches TRACES, a benchmark grading AI on open-ended discovery instead of known answers — Faheem_uh · 2026-09-11