Teknium says Anthropic still leads on long-context coherence and cost
Teknium · x · 2026-07-22
Teknium says long-context quality and affordability remain the main bottleneck for practical model use.
After testing GPT-5.6 Sol and Terra, the post argues that Anthropic is still the clear leader in long-context coherence and may even be cheaper at that scale. It claims OpenAI charges about 2x once prompts exceed 350K tokens, but the models are not worth using there because coherence falls apart. By contrast, the author says Opus and Fable stay coherent even at 800K+ context.
The post also wonders what happened to Magic.dev’s promised 100M-token context window, suggesting that the idea may not have worked out in practice.
More from Models
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- awesome-llm-leaderboards: an open-source directory of LLM leaderboards, pricing tables, comparison tools — Last_Establishment_1 · 2026-09-11
- Anthropic claims it works to keep eval environments unidentifiable to models — MaxKannen · 2026-09-11
- Nex N2.5 Pro released on Hugging Face with 407GB of weights — jinnyjuice · 2026-09-11
- RoMa v2 image matching model unveiled in the usual black poster — ducha_aiki · 2026-09-11
- OpenAI rated Astra 'Critical' for cyber capabilities — and admits it's harder to monitor — theguywhobuilds · 2026-09-11