Anthropic's Minor .1 Releases Show Benchmark Jumps That Make No Sense
thursdai_pod · x · 2026-09-07
The Thursdai podcast flags that Anthropic's Fable 5.1 and Mythos 5.1 releases, despite being minor .1 version bumps, show implausibly large benchmark jumps — including on Terminal-Bench 4, which didn't even exist last week. @altryne breaks down why these numbers look off.
More from Models
- Meta researcher: horrifying infra, not talent, is why OSS can't catch closed frontier — A_K_Nain · 2026-10-23
- TypeSafe's Jev: a "Decision Model" LLM That Returns Floats at $0.042/M Input Tokens — ariG23498 · 2026-10-23
- Microsoft's MAI-Base-2 scaling ladder pegs the L42 run at ~1.8×10^23 FLOPs — teortaxesTex · 2026-10-23
- Local model agentic coding benchmark: 27B matches 125B, tool-calling is the lever — Joralk_ · 2026-10-23
- NVIDIA open-sources PersonaPlex-7B, a full-duplex voice AI model that listens and talks simultaneously — solyarisoftware · 2026-10-23
- NVIDIA's KumoRFM-2: a foundation model that predicts churn, fraud and demand straight from relational databases — solyarisoftware · 2026-10-23