Claude Fable 5.1 (high) hits 92.3% on WeirdML, beating Fable 5 by 0.4% for new SOTA
teortaxesTex · x · 2026-09-03
Claude Fable 5.1 (high) scored 92.3% on the WeirdML benchmark, edging out Fable 5 (max) by 0.4% and setting a new SOTA, with records on 3 of 17 tasks and strong scores across the board.
Benchmark maintainer @htihle notes the eval is close to saturation: at least 93.9% is known to be achievable, and it's unclear how long frontier models will keep being run. Commenters add the benchmark stays discriminative for smaller models for now.
More from Models
- Mistral's Voxtral 3 speech models land #3 on STT leaderboard at $13/1M chars — ArtificialAnlys · 2026-10-21
- Perplexity ships Decider V1.2, tops Vals AI's new ClaimBench decision-model benchmark — bo_wangbo · 2026-10-21
- Omnii-1 genome model debuts: first AI-designed phages ever given to a human patient — JosephJacks_ · 2026-10-21
- Nous Portal Pricing Revealed: Unused Credits Roll Over, Up to $100 Cap on $200 Tier — alexcovo_eth · 2026-10-21
- 1.3B open-source doc parser OXR tops three benchmarks, parsing 100 pages in 101 seconds — s_mohinii · 2026-10-21
- How LLMs store facts: three learning phases, attention circuits, and hallucinations — scott_linderman · 2026-10-21