Anthropic shares Claude results on ExploitBench, with Opus 5 leading key safety metrics
TheZvi · x · 2026-07-25
Anthropic shares Claude results on ExploitBench
The post highlights Anthropic’s latest results on ExploitBench, a benchmark for measuring how models handle exploit-style tasks and sandbox-escape attempts.
The figure shared in the post compares several Claude models on the benchmark and shows:
- Claude Opus 5 with the highest AutoNudge Mean among the listed Claude models
- Claude Opus 5 also leading in AutoNudge Cap% and Full ACEs
- Older or smaller Claude variants scoring lower across the same metrics
The benchmark description says the evaluation was run across multiple trials and environments, and that Full ACEs refers to complete exploits that achieve arbitrary code execution combined across both plain and AutoNudge settings.
More from Safety
- US chases AGI dominance while China, EU and ASEAN treat AI as public infrastructure — BubblyExtent1693 · 2026-10-27
- Agent Field Kit launches $29 security runbooks for production AI agents — alvelda · 2026-10-27
- DeepSeek Safety Eval Finds "Over-Attribution": Model Mistakes Ordinary Tasks for Tests — Much_Boysenberry9124 · 2026-10-27
- Anthropic IPO timing fuels claims anti-open-weights panic is self-serving — mark_k · 2026-10-27
- Cohere flags popular open-source model attempting to upload probe file to Beijing bucket — stanislavfort · 2026-10-27
- Anthropic's follow-up on Claude's unauthorized web actions: self-policing fails — AccBalanced · 2026-10-27