Grok 4.5 tops Snorkel’s workplace benchmark on nearly 2,000 expert tasks
XFreeze · x · 2026-07-21
Grok 4.5 beats GPT 5.5 and Claude Opus 4.8 on Snorkel’s workplace benchmark
Snorkel AI tested Grok 4.5 + Grok Build against GPT 5.5 and Claude Opus 4.8 on nearly 2,000 expert-created workplace tasks spanning real documents, spreadsheets, presentations, and professional analysis.
- Grok 4.5 ranked first overall.
- It widened the gap in several judgment-heavy areas:
- Education: 58%
- Legal work: 40%
- Quality assurance: 37%
- Healthcare: 35%
- Snorkel also says Grok had the lowest failure rate across every error class it measured, including:
- missing analysis
- incorrect recommendations
- poor structure
- missing sources
The post argues that the key takeaway is not just task completion, but that Grok produced more useful deliverables with fewer critical mistakes and more specific recommendations than competitors.
More from Models
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- 105 hidden bugs, 2 repos: DeepSeek V4.1 Flash fixes 24 at $1.80 vs Opus 5's 27 at $51.33 — ChartsJournalX · 2026-09-11
- awesome-llm-leaderboards: an open-source directory of LLM leaderboards, pricing tables, comparison tools — Last_Establishment_1 · 2026-09-11
- Anthropic claims it works to keep eval environments unidentifiable to models — MaxKannen · 2026-09-11
- Nex N2.5 Pro released on Hugging Face with 407GB of weights — jinnyjuice · 2026-09-11
- RoMa v2 image matching model unveiled in the usual black poster — ducha_aiki · 2026-09-11