Grok 4.6 Benchmarks: Coding on Par with Top Open Models, Debate on Opus Level

Within days of Grok 4.6's release, multiple independent developers ran intensive tests. Consensus: its coding ability rivals top open models like Kimi K3, sufficient to take over Claude Sonnet 4.5's daily workloads, with faster speed and lower cost; Minecraft spatial building and video generation also improved. Dispute: whether it reaches Claude Opus level, with testers reaching opposite conclusions.

Confirmed

• Value: scaling01 says Grok 4.6 slightly outperforms Kimi-K3 in both performance and efficiency despite being nearly half the size; MiaAIlab's 8-hour test in 'low' effort mode shows it matches Kimi K3 on kernel and modding tasks, with faster speed and lower token usage.
• Coding positioning: bindureddy believes 4.6 reaches Sonnet level and surpasses Gemini overall; his team has migrated some Sonnet workloads. Its scores approach the top tier, and due to speed it is more practical than K3.
• Spatial & multimodal: adonissingh found significant improvement in spatial judgment and aesthetics over 4.5 in a Minecraft 'Klein bottle on 3D axes' task; Aizkmusic built the Golden Gate Bridge in MC Bench in just two interactions, with the only error being a wrong block ID, and also produced a coherent flythrough video via two-shot generation.
• Iteration & flaws: karminski3 measured backend Agentic Coding benchmark improvement under 5% over 4.5; frontend results pending. Maziyar Panahi notes a clear feel difference from 4.5, crediting xAI's mid-training and post-training. Aizkmusic warns coding is not yet at Fable's level, not recommended for production, and occasionally uses rare words like 'proscenium'.

Unconfirmed

• Whether it reaches Opus level: sergeykarayev's Superconductor blog review places Grok 4.6 alongside Opus 4.8/5, Fable 5, and Kimi K3 on the 'pedestal' and as a daily driver; kevinnbass says it is nearly indistinguishable from Opus 5 in data mining workflows, with lower cost and faster speed, even better in some aspects; but bindureddy explicitly states it is far from Opus level, with capability ceiling below top closed models.

Why it matters

• If the 'half size, slightly better performance' comparison holds, Grok 4.6 will directly challenge Sonnet-tier commercial workloads with speed and cost advantages, and at least one team has already migrated.
• The disagreement among reviewers on the 'top tier' boundary shows that gaps among top models are now at the perceptual level, making selection more dependent on workflow-specific testing than benchmark scores.

2026-08-13 ~ 2026-08-14 · 16 related posts

Full story(5 episodes)→

• Episode 1: Grok 4.6 Spotted in Cursor Then Pulled, Unconfirmed by xAI(2026-08-11, 7 posts)
• Episode 2: Grok 4.6 Released with Multi-Tool Coding Benchmark(2026-08-11, 4 posts)
• Episode 3: xAI Releases Grok 4.6 with Top Performance and Same Pricing(2026-08-12, 92 posts)
• Episode 4: Grok 4.6 Benchmarks: Coding on Par with Top Open Models, Debate on Opus Level(2026-08-13, 16 posts)
• Episode 5: Grok 4.6 tops real-world coding benchmarks with standout cost efficiency(2026-08-14, 10 posts)

• [source] Grok 4.6 Slightly Outperforms Nearly Double-Sized Kimi-K3 — scaling01 · 2026-08-13
• Grok 4.6 Excels in MC Bench: Builds Golden Gate Bridge in Just 2 Turns — Aizkmusic · 2026-08-13
• Grok Builds Golden Gate Bridge in MC Bench in Just 2 Turns — Aizkmusic · 2026-08-13
• Grok 4.6 Tested: Generating Coherent Video in Two Shots — Aizkmusic · 2026-08-13
• Testing Grok 4.6: Decent Coding Skills but Unusual Vocabulary — Aizkmusic · 2026-08-13
• [source] Hands-on with Grok 4.6: Sonnet-class Performance at a Fraction of the Cost — bindureddy · 2026-08-13
• Grok-4.6 Tested: Agentic Coding Benchmark Score Improves by ~5% — karminski3 · 2026-08-13
• User Reports Grok 4.6 as Highly Pedantic with Extensive Self-Checking — intellectronica · 2026-08-13
• Grok Iteration Test: Version 4.6 Crushes Previous Build in Minecraft Spatial Judgment — adonis_singh · 2026-08-13
• Grok 4.6 Review: Closes Gap with Qwen and Kimi, But Lags Behind Top Proprietary Models — bindureddy · 2026-08-14
• Grok 4.6 Tested: Competitive Speed, But Far From Opus Class — bindureddy · 2026-08-14
• Grok 4.6 Joins Benchmark Pantheon, Becomes Daily Driver Alongside Opus and K3 — sergeykarayev · 2026-08-14
• Grok 4.6 Praised: Matches Kimi K3 on Kernel and Modding, Faster and More Efficient — elonmusk · 2026-08-14
• [source] Grok 4.6 Enters the Pantheon: Matches Opus and Kimi in Coding — sergeykarayev · 2026-08-14
• Grok 4.6 Matches Claude Opus 5 in Data Mining Workflows at Lower Cost — kevinnbass · 2026-08-14
• Engineer's first take: Grok 4.6 feels fresh, a big step from Grok 4.5 — MaziyarPanahi · 2026-08-14