Long-context models still waste tokens by copying the prompt into reasoning
eyishazyer · x · 2026-07-23
A post about a paper argues that long-context reasoning still has a hidden failure mode: even strong models copy large chunks of the prompt into their own chain-of-thought, wasting tokens and hurting accuracy.
- The assumption that long context solved retrieval is challenged.
- Copying gets worse as inputs get longer.
- The result quietly eats token budget and degrades performance.
- The proposed fix is not just more context, but smarter context handling.
Related event: Study Reveals Long-Context Models Waste Tokens Copying Text(2 posts)→
More from Research
- GameWorld wins Best Paper Runner-Up at ECCV 2026 Multimodal Digital Agents Workshop — MikeShou1 · 2026-09-11
- 3D ResNet Paper Crosses 3,000 Citations Eight Years After CVPR 2018 — HirokatuKataoka · 2026-09-11
- Sample selection and ordering matter a lot in LLM training: DataFlex makes data scheduling dynamic — Puzzleheaded_Box2842 · 2026-09-11
- Jeff Heaton's Intro to the Math of Neural Networks eBook Is Free to Download — blaizedsouza · 2026-09-11
- Mathematician Daniel Litt Launches Problem Repo to Track Human vs AI Progress: 15 Problems, 1 Solved — littmath · 2026-09-11
- Open ECDSA.fail challenge uses AI agents to shrink Shor's-algorithm quantum circuits for Bitcoin keys — StefanoGogioso · 2026-09-11