One LLM already runs at 14,000 tokens/sec—frontier intelligence at 5,000 tok/s within 5 years?
dolo937 · reddit · 2026-09-02
The author speculates on inference speed as a paradigm shift: one LLM (chatjimmy.ai) already exceeds 14,000 tokens/sec, OpenAI's ultrafast mode serves 750 tok/s, and Minimax H3 generates video faster than humans can watch. They predict frontier intelligence at 5,000+ tokens/sec within five years, raising the question of a world where machine output outpaces human thinking and consumption.
More from AGI Musings
- Essay: AI made test-style intelligence the cheapest commodity — judgment is what's left — r0ck3t23 · 2026-10-18
- "Yes, It's Lazy. That's the Point": Pushing Back on Humanoid Robot Housework Critics — VraserX · 2026-10-18
- Jason Furman: optimistic on AI productivity, skeptical firms can profit from it — sebkrier · 2026-10-18
- 562 AI PM job postings split into 4 roles — Model PM tops pay at $345K median — aakashgupta · 2026-10-18
- Longevity influencer: this is the last decade dying of old age is 'normal' — rand_longevity · 2026-10-18
- Only 85% of Anthropic hours and 76% of OpenAI workdays are agentic — yacineMTB · 2026-10-18