DeepSeek v4.1 flash paper figure shows sharp quality jump at 1M-token context — agents are context-hungry
TheZachMueller · x · 2026-09-19
andrewncarr highlighted a must-study figure from the DeepSeek v4.1 flash paper: quality rises sharply once context length is extended to 1M tokens, with similar gains visible in MiMo v2.6's RL graphs. His takeaway: agents are context-hungry. Replying, Zach Mueller joked, "brb as I load all of Wikipedia into context every turn."
More from Models
- Musk cites unsustainable Grok Bot costs as Hermes offers one-command agent migration — Teknium · 2026-11-04
- Hobbyist rewrites Qwen 0.6B weights with 39.8M tokens, no gradients, in 3h12m — Altruistic_Heat_9531 · 2026-11-04
- Same leak, reshared: ChatGPT's five family plan prices spotted again — heyshrutimishra · 2026-11-04
- KOL visits StepFun's Shanghai office, hints a powerful new model is coming — teortaxesTex · 2026-11-04
- Fable 5.5 delayed as Anthropic reportedly bets OpenAI's Astra 6.2 won't beat it — haider1 · 2026-11-04
- ByteDance open-sources Axion 1.0-35B agent foundation model with full reproducible recipe — pmttyji · 2026-11-04