PUMA early-exit framework cuts reasoning tokens by 26.2% across 5 models
jiqizhixin · x · 2026-07-26
PUMA cuts reasoning tokens by spotting when a model has already converged
Researchers from UIC, Google and others introduce PUMA, a plug-and-play framework for reasoning models that detects when intermediate reasoning has become redundant and exits early without hurting accuracy.
- It pairs a lightweight redundancy detector with answer-level verification.
- The detector compares recent step embeddings and flags repeated or near-duplicate reasoning.
- Verification then probes a trial answer from the truncated prefix to check confidence and consistency before stopping.
- If verification fails, generation continues; a fallback Loop Breaker handles late-stage repetitive loops.
- Reported result: 26.2% fewer tokens on average across 5 reasoning models and 5 benchmarks, while preserving accuracy and chain-of-thought quality.
Paper: Stop When Reasoning Converges: Semantic-Preserving Early Exit for Reasoning Models
More from Research
- Cognition's SWE-2 uses a KKT duality argument in RL to shift the effort Pareto curve — YouJiacheng · 2026-09-11
- VidMap uses RoMa coarse matching on all frames, fine-scale only for keyframes — ducha_aiki · 2026-09-11
- Bug Hunt Bench author: leaderboard noise is about 2-3 points — PawelHuryn · 2026-09-11
- PNAS paper shows a tiny billiard-ball system is a universal computer — undecidability lives in two dimensions — eigensteve · 2026-09-11
- New paper: Absolute pose estimation from affine cues and gravity direction — ducha_aiki · 2026-09-11
- LoMa Paper Ships REALLY HardPairs Dataset, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11