Kimi K3.1 Pro tops Artificial Analysis Cyber Index among open models at 64%, near GPT-6 Sol
ArtificialAnlys · x · 2026-10-24
- Kimi K3.1 Pro scores 64% on the Artificial Analysis Cyber Index, making it the #1 openly-available model for agentic cyber defense — up 23 points from Kimi K3 (41%), 7 ahead of DeepSeek V4.1 Flash 1017 (57%), and just 5 behind trusted-access GPT-6 Sol (Daybreak Blue, max, 69%).
- Best-in-class CyberGym-E2E-AA: 95%, above GPT-6 Sol (93%); CWE-Bench-AA 61%, DeepsecBench-AA 37%.
- Safety refusals matter: GPT-6 Sol's trusted-access version scores 32 points above its public counterpart; K3.1 Pro hits no refusals.
- Cost: token prices cut 33% ($2/$10), but 2x more input tokens push Cost per Task up 15% to $2.81 — above GPT-6 Sol ($1.77) and far above DeepSeek ($0.42).
Related event: Kimi K3.1 Pro tops open models on Artificial Analysis Cyber Index(2 posts)→
More from Models
- Meta's Muse Spark Open hits ~150M tokens/s per MW on NVIDIA GB300 in early benchmarks — ArtificialAnlys · 2026-10-24
- OpenAI red team finds critical Brotli RCE (CVE-2026-11149) hitting Node.js, Bun, Envoy — moyix · 2026-10-24
- Kimi K3.1 falls short of benchmarks in hands-on testing, says KOL — DeryaTR_ · 2026-10-24
- Kimi K3.1 Pro tops agentic coding benchmarks but may lag on AA-3D — ArtificialAnlys · 2026-10-24
- ValsAI Index Finds Fireworks AI Beats DeepSeek and Moonshot's Own APIs on Agentic Tasks — sophiamyang · 2026-10-24
- TensorSharp hits 5.5× llama.cpp prefill throughput on DeepSeek V4.1 Flash across five A40s — fuzhongkai · 2026-10-24