Grok 4.7 beats 4.6 by just 0.1 across runs: 'random noise,' independent eval finds
PawelHuryn · x · 2026-09-22
Pawel Huryn's multi-run evals found Grok 4.7 (max) beat 4.6 (max) by just 0.1 points on n=4, calling it random noise and stopping that effort level. At xhigh: 4.6 scored 27/30/29, 4.7 scored 25/30/31 across three runs — none beating the median of Muse Spark 1.3. Tests used hard problems frontier models missed in early 2026, not planted bugs.
Related event: Bug Hunt Bench: GPT-6 Astra Tops 105-Bug Fixing Test, MiMo Stuns on Value(18 posts)→
More from Models
- Opus 5.5 feels nerfed — user blames system prompt restrictions, not the model — oyacaro · 2026-11-12
- ChatGPT now links to brand homepages far more, reshaping brand-mention tracking — lilyraynyc · 2026-11-12
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12
- LMArena Launches Agent Arena for Head-to-Head Agent Evaluation — arena · 2026-11-12