More Thinking Tokens May Cause Context Rot
dejavucoder · x · 2026-07-13
The author observed that in some cases, high mode performs better than xhigh mode, or at least similarly, but with lower costs and faster speeds.
The speculated reason is that more thinking tokens might actually lead to worse context rot, meaning the thinking process scrambles the context the more it ponders.
More from Models
- Claim says Kimi was distilled from Fable, sparking a model-attribution jab — cephaloform · 2026-07-22
- Gary Marcus says LLM math skills are like knowing only a car’s engine size — GaryMarcus · 2026-07-22
- OpenAI’s Codex + GPT-5.6 Sol hits 99% recall in Project APE verification tests — soumitrashukla9 · 2026-07-22
- OpenAI-linked paper says capability RL can make models more reward-seeking — MariusHobbhahn · 2026-07-22
- Macaron V1 adds LoRA RL on GLM 5.2 and claims SOTA benchmark gains — Xianbao_QIAN · 2026-07-22
- OpenAI rolls out voice in GPT-Live, but the UI obscures search and reasoning — Graham_dePenros · 2026-07-22