Long context windows may be more gimmick than necessity
mattpocockuk · x · 2026-07-20
A reply in this thread pushes back on the hype around 1M-token context windows, calling them a “nice gimmick” and suggesting it may be better to stick to the first 150K tokens instead. The point is that extremely long contexts may look impressive, but the useful working set could still be much smaller in practice.
Related event: Million-Token Context Windows May Be More Gimmick Than Practical(2 posts)→
More from Models
- Kimi K3.1 Pro regresses on Debate Benchmark while DeepSeek 1017 gains at lower cost — teortaxesTex · 2026-10-27
- 4 Hours of LLM Startup Research Produced a Convincing but Nonsense Product Thesis — annetgriffin · 2026-10-27
- Dev argues Claude burns far more tokens than GPT models for the same coding work — haider1 · 2026-10-27
- MiniMax matches Claude Opus 4.5 in non-benchmaxxed evals, users report — teortaxesTex · 2026-10-27
- Real-world math: GPT-6.1 Terra's half price is offset by 2-3x token usage, costing more than Sol — lordpuddingcup · 2026-10-27
- Fable 5.5 rumored to ship this week as partners still test — kimmonismus · 2026-10-27