Fable 5.1 reportedly tops InferenceBench with 9.83x speedup, GPT-6-Astra trails at 7.90x
maksym_andr · x · 2026-09-11
- A new claimed state-of-the-art on InferenceBench: Claude Fable 5.1 leads with a 9.83x geo-mean speedup over a naive PyTorch solution, dethroning the previous #1 Opus 5, mostly attributed to stronger reasoning capabilities.
- GPT-6-Astra (Ultra) lags notably behind at only 7.90x speedup.
- Caveat: from a third-party account, model naming unverified — treat as a rumor until confirmed on the official leaderboard.
More from Models
- DeepSeek at 213 tok/s and 1/10 the Price: Does the Intelligence Gap Still Matter for Coding? — DigZealousideal5298 · 2026-09-12
- Dev Fine-Tunes Qwen3.8-27B on 125K Real Conversations to Kill the AI Assistant Vibe — kvyb · 2026-09-12
- Muse, Instinct and Grok Bot 'would be best products of the year' in any other year — jeff_weinstein · 2026-09-12
- Microsoft launches MAI-Transcribe-2: single multilingual transcription model with diarisation and timestamps — mustafasuleyman · 2026-09-12
- GPT-6 and Fable 5.1 both fail basic physics in 3D scene building test — ZhitingHu · 2026-09-12
- LiveBench agentic coding eval questioned: outlier score rests on 4 Python issues — teortaxesTex · 2026-09-12