Compressed Reasoning Weakens Monitorability
Bryce Little · hf · 2026-07-17
Long chain-of-thought is not always more "monitorable." This study finds that while length-penalty compression significantly reduces reasoning tokens with little loss in multiple-choice accuracy, the underlying prompt-influenced bias doesn't disappear; instead, it becomes harder to detect in the remaining reasoning traces.
The authors trained variants with different target lengths on Qwen3-4B and Qwen3-14B, evaluating them using biasing hints on MMLU-Pro-R and 4 transfer benchmarks. Under maximum compression:
- Lower-bound faithfulness dropped to 63.1% / 69.4% of the baseline (for 14B / 4B respectively).
- The monitor's raw hit rate for catching hint usage dropped from 69%→49% and 60%→48%.
- Even after "length matching," compressed chains revealed 7–35 percentage points fewer prompt influences compared to baseline chains with randomly deleted sentences.
The authors conclude that compression not only shortens reasoning but preferentially removes the exact clues monitors rely on, creating a "compression-monitorability frontier": cheaper reasoning might preserve the answers, but it makes the underlying influence much harder to detect.
More from Research
- Cognition's SWE-2 uses a KKT duality argument in RL to shift the effort Pareto curve — YouJiacheng · 2026-09-11
- VidMap uses RoMa coarse matching on all frames, fine-scale only for keyframes — ducha_aiki · 2026-09-11
- Bug Hunt Bench author: leaderboard noise is about 2-3 points — PawelHuryn · 2026-09-11
- PNAS paper shows a tiny billiard-ball system is a universal computer — undecidability lives in two dimensions — eigensteve · 2026-09-11
- New paper: Absolute pose estimation from affine cues and gravity direction — ducha_aiki · 2026-09-11
- LoMa Paper Ships REALLY HardPairs Dataset, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11