Grok 4.5 still ranks #1 on VulcanBench software engineering benchmark
XFreeze · x · 2026-08-22
Grok 4.5 maintains the #1 spot on VulcanBench Eval Suite 3. This benchmark tests models on 23 hard software engineering tasks derived from real merged open-source PRs, demonstrating Grok's insanely strong engineering capabilities.
Related event: Grok 4.5 Tops VulcanBench Real-World Engineering Benchmark(2 posts)→
More from Models
- Blogger claims 'Astra 6' delivered his first real AGI moment via novel math results — haider1 · 2026-10-17
- d1-3B beats Vega 4B: 3.4x faster with +7.2pp accuracy on M4 Max — JosephJacks_ · 2026-10-17
- Analyst: the widening compute gap alone may end China's frontier-model catch-up — teortaxesTex · 2026-10-17
- Vals Science Index: OpenAI Models Lead Overall, but No Model Sweeps Every Science Discipline — BenBlaiszik · 2026-10-17
- shadcn spots Claude doing 'retroactive edits' — striking through its earlier wrong answer — shadcn · 2026-10-17
- Perplexity open-sources pplx-decider v1.2 multimodal decision models, Flash up to 5x faster — denisyarats · 2026-10-17