Kimi K3 beats GLM-5.2 in exploit tests but still fails end-to-end attacks
kevinsxu · x · 2026-07-28
The post quotes the Kimi K3 paper’s cyber evaluation results and notes that a joint UK AI Security Institute / NIST CAISI assessment reached similar conclusions.
- Kimi K3 outperforms GLM-5.2 on exploit development.
- It scores 32% vs. 24% on ExploitBench.
- On a simulated enterprise network task that takes a human expert about 20 hours, it needs 17 steps vs. 11 steps.
- But it still trails frontier cyber-capable models on end-to-end exploit completion, achieving arbitrary code execution on 0 of 41 tasks.
The punchline is that China and the US institutions agree on the ranking, at least on this slice of cyber capability.
Related event: Kimi K3 Security Eval: High Exploit, Low Guardrails(4 posts)→
More from Models
- Unreleased 'GPT 6 Sol' model spotted in OpenAI's API — SteveEricJordan · 2026-09-11
- DeepSeek update keeps cache hits mid-conversation, cuts costs 36.6% — teortaxesTex · 2026-09-11
- AI Sextet offers 6 models free and unlimited for 14 days, including DeepSeek and Qwen — airesearch12 · 2026-09-11
- BullshitBench update: GPT-6-Astra beats all prior OpenAI models but still trails Anthropic — scaling01 · 2026-09-11
- Astra Scores 83% on GauntletBench, First Computer-Use Agent to Beat Human Baseline — ducha_aiki · 2026-09-11
- Kimi K2.8 Preview rolls out: near-K3 coding performance, 1M context for all tiers — teortaxesTex · 2026-09-11