Long context windows may be more gimmick than necessity
mattpocockuk · x · 2026-07-20
A reply in this thread pushes back on the hype around 1M-token context windows, calling them a “nice gimmick” and suggesting it may be better to stick to the first 150K tokens instead. The point is that extremely long contexts may look impressive, but the useful working set could still be much smaller in practice.
Related event: Million-Token Context Windows May Be More Gimmick Than Practical(2 posts)→
More from Models
- Rumor claims Kimi faked performance by serving Claude; DeepSeek new model surprises in evals — realsohamparekh · 2026-09-11
- GPT-5.6 writes well but is instantly forgettable, user complains — BasedRaddka · 2026-09-11
- Opus Refuses Protein Research Codebase Over 'Safety' Concerns, Dev Considers Rolling His Own — josephdviviano · 2026-09-11
- User Hails Unconfirmed 'DeepSeek 4.1 Flash' as an Inflection Point in LLMs — himanshustwts · 2026-09-11
- Terminal Bench v4: GLM-5.3 Leads at 41.9%, Kimi-K3 Underwhelms at 12.6% — Ok_Warning2146 · 2026-09-11
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11