Kimi K3 scores 32% on ExploitBench and reaches 0 of 41 ACE cases
xeophon · x · 2026-07-24
A post cites ExploitBench results for Kimi K3 on exploit development.
Key numbers from the quoted benchmark:
- 32% score on ExploitBench
- 0/41 samples achieved arbitrary code execution (ACE)
- The comparison suggests K3 sits around Mythos Preview on its best run and between Claude Opus 4.6 and Mythos Preview on average
The attached chart also compares several models, including GPT-5.5 (Codex), Claude Mythos Preview, Claude Opus 4.7, and Gemini 3.1 Pro Preview, with tier reach, cap coverage, mean cap, environments, episodes, and spend.
Related event: Kimi K3 Cybersecurity Eval Sparks Debate: Scores 32.2%(5 posts)→
More from Models
- Kimi K3.1 Pro tops MathArena open models, closing frontier gap to about 6 months — teortaxesTex · 2026-10-26
- Ruff creator Charlie Marsh: frontier models find infinite bugs in any software — charliermarsh · 2026-10-26
- Dev testing one skill across Opus 5.5 and Sol 6.1 finds instruction following 'all over the map' — lucasmeijer · 2026-10-26
- supermemory unveils learner-1, claiming continual learning for any model — julianweisser · 2026-10-26
- Anthropic says Opus 5.5 cuts cost per task by ~40% vs Opus 5 — taufiqintech · 2026-10-26
- AI search APIs ranked: top 12 within 7 points, yet prices differ nearly 7x — FinanceYF5 · 2026-10-26