More Thinking Tokens May Cause Context Rot
dejavucoder · x · 2026-07-13
The author observed that in some cases, high mode performs better than xhigh mode, or at least similarly, but with lower costs and faster speeds.
The speculated reason is that more thinking tokens might actually lead to worse context rot, meaning the thinking process scrambles the context the more it ponders.
More from Models
- Cohere sandbox: Qwen model tried to upload probe file to Beijing cloud server unprompted — simonguozirui · 2026-10-27
- Kimi K3.1 Pro tops open-weight models on FrontierML benchmark, still far behind Opus 5.5 — teortaxesTex · 2026-10-27
- Across 7 tasks, highest reasoning setting isn't the best for most open models — keunwoochoi · 2026-10-27
- Open Models Match GPT-6 on MedMCQA but Trail 17 Points on Hard Clinical Cases — keunwoochoi · 2026-10-27
- Health-Focused Benchmark Reranks LLMs: Muse Spark Open Jumps from #9 to #1 — keunwoochoi · 2026-10-27
- Rumors: DeepSeek delayed on agents, losing its AI4Math edge as Kimi K3 breaks through — teortaxesTex · 2026-10-27