Claim that Claude Fable 5.1 beat human baseline contradicts SimpleBench's own 83.7% figure
koltregaskes · x · 2026-09-06
A viral post claims Claude Fable 5.1 is the first model to beat the human baseline on SimpleBench, but the cited SimpleBench page itself says otherwise: the unspecialized human baseline is 83.7%, while Claude Fable scored 81.9% — still below it. SimpleBench has 200+ multiple-choice questions testing spatio-temporal reasoning, social intelligence, and linguistic adversarial robustness (trick questions), where nine ordinary high-school-level participants outperformed every frontier LLM. The model name and claim are unverified and appear to contradict the source.
More from Models
- Meta researcher: horrifying infra, not talent, is why OSS can't catch closed frontier — A_K_Nain · 2026-10-23
- TypeSafe's Jev: a "Decision Model" LLM That Returns Floats at $0.042/M Input Tokens — ariG23498 · 2026-10-23
- Microsoft's MAI-Base-2 scaling ladder pegs the L42 run at ~1.8×10^23 FLOPs — teortaxesTex · 2026-10-23
- Local model agentic coding benchmark: 27B matches 125B, tool-calling is the lever — Joralk_ · 2026-10-23
- NVIDIA open-sources PersonaPlex-7B, a full-duplex voice AI model that listens and talks simultaneously — solyarisoftware · 2026-10-23
- NVIDIA's KumoRFM-2: a foundation model that predicts churn, fraud and demand straight from relational databases — solyarisoftware · 2026-10-23