Kimi K3 scores 32% on ExploitBench, far behind U.S. frontier models
The Decoder · rss · 2026-07-24
A report from The Decoder says Moonshot AI's Kimi K3 performed far worse than frontier U.S. models on offensive cyber tasks.
According to the British AI Security Institute and the U.S. Center for AI Standards and Innovation:
- 32% on ExploitBench for Kimi K3
- 76% for leading U.S. models
- safeguards did not reliably block exploit development or simulated attacks
The article argues the gap between Kimi K3's strong general benchmarks and weak cyber performance may align with allegations that Moonshot AI distilled Anthropic models.
More from Models
- Local benchmark: Flint matches Qwen3.6 quality at 50/52 while running 3.6x faster on M4 Pro — RichardSocher · 2026-10-27
- Mirendil debuts Fern, a from-scratch model with up to 10M token context built for agentic AI R&D — shayan_ · 2026-10-27
- ICML 2026 position paper: LLM 'thinking traces' are a harmful anthropomorphism — rao2z · 2026-10-27
- One stray 'u' and Claude starts spelling like a Brit — cantrell · 2026-10-27
- Cohere's Invent-A-Dataset paper: zero-seed synthetic data beats frontier APIs on quality and diversity — idanbeck · 2026-10-27
- ARC Prize redesigns leaderboard: highest reasoning effort by default, CSV export — mhmazur · 2026-10-27