Frontier AI models begin crossing the human baseline on SimpleBench
Bojackin_Around · reddit · 2026-09-06
- SimpleBench targets reasoning humans find easy but LLMs have long struggled with: commonsense, spatial/temporal reasoning, social judgment, and traps for shallow pattern-matching.
- Plotted model scores are averages over 5 runs; random guessing scores 16.7% — close to where models started just over two years ago.
- The human baseline comes from 9 native-English, non-specialist participants, each answering a random subset of 25 questions, with at least high-school math proficiency (likely above average).
- The poster notes frontier models' average scores are now crossing this human baseline, a milestone on questions designed to resist shortcut learning.
Related event: Frontier AI Models Surpass Human Baseline on SimpleBench(2 posts)→
More from Models
- Meta researcher: horrifying infra, not talent, is why OSS can't catch closed frontier — A_K_Nain · 2026-10-23
- TypeSafe's Jev: a "Decision Model" LLM That Returns Floats at $0.042/M Input Tokens — ariG23498 · 2026-10-23
- Microsoft's MAI-Base-2 scaling ladder pegs the L42 run at ~1.8×10^23 FLOPs — teortaxesTex · 2026-10-23
- Local model agentic coding benchmark: 27B matches 125B, tool-calling is the lever — Joralk_ · 2026-10-23
- NVIDIA open-sources PersonaPlex-7B, a full-duplex voice AI model that listens and talks simultaneously — solyarisoftware · 2026-10-23
- NVIDIA's KumoRFM-2: a foundation model that predicts churn, fraud and demand straight from relational databases — solyarisoftware · 2026-10-23