Grok 4.5 Tops VulcanBench Real-World Engineering Benchmark

Grok 4.5 High ranked first on VulcanBench Eval Suite 3, which tests models on 23 hard software engineering tasks drawn from real open-source PRs. The results also suggest that higher effort levels do not necessarily yield higher precision.

2026-08-22 ~ 2026-08-22 · 2 related posts

• VulcanBench: Grok 4.5 High Leads, Max Effort Doesn't Equal Better Accuracy — elonmusk · 2026-08-22
• Grok 4.5 still ranks #1 on VulcanBench software engineering benchmark — XFreeze · 2026-08-22