Independent Tests Show Grok 4.6 (high) Beating 4.7, 23 vs. 19
PawelHuryn · x · 2026-09-22
PawelHuryn ran repeated independent benchmarks comparing Grok 4.6 and 4.7: at high effort 4.6 won 23 vs. 19, and even 4.6 medium scored better. A fourth run at max effort gave 4.7 only a 0.1-point edge — noise. He suspects 4.7 was tuned for popular benchmarks rather than genuinely improved.
Related event: Bug Hunt Bench: GPT-6 Astra Tops 105-Bug Fixing Test, MiMo Stuns on Value(18 posts)→
More from Models
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12
- LMArena Launches Agent Arena for Head-to-Head Agent Evaluation — arena · 2026-11-12
- LLMs lack hyperlocal municipal data, explains disputed Texas power outage debate — csuwildcat · 2026-11-12
- Claude API's per-message effort lets you switch reasoning levels without breaking prompt cache — lyraxana · 2026-11-12