Kimi K3.1 Pro benchmarks leak: tops SWE Marathon at 51.7, near Claude Opus 5.5
No-Head-Royal · reddit · 2026-10-24
A Reddit user posted a benchmark comparison chart for Kimi K3.1 Pro against Claude Opus 5.5, GPT-6 Astra, Fable 5.1, DeepSeek-V4.1-Flash and GLM-5.3:
- SWE Marathon: Kimi K3.1 Pro leads at 51.7, ahead of Opus 5.5 (46.3).
- Terminal-Bench 4.0: 65.7, just behind Opus 5.5 (66.4).
- Humanity's Last Exam Full w/ tools: 70.0, first place.
- Also tops OfficeQA Pro v2, ZeroBench, Agents' Last Exam; trails on Terminal-Bench Science 0.1 (38.1) and BenchCAD (92.7).
Overall K3.1 Pro is strong on agentic/long-horizon coding benchmarks while lagging on some science-heavy ones.
Related event: Moonshot Releases Kimi K3.1 Pro, Open-Weight Model Rivaling GPT-6(33 posts)→
More from Models
- Kimi 3.1 Pro priced like Argon but scores like DeepSeek V4.1 Flash on meme 'Runescape Bench' — scaling01 · 2026-10-24
- Jon Barron details his workflow: Gemini runs experiments, drafts the paper, then rewrites in his style — jon_barron · 2026-10-24
- Users praise Gem Argon for cultural fluency: a frontier model that roots for you — sebkrier · 2026-10-24
- User says Opus silently downgraded to 4.8 mid-task, then told him to talk to people — natesiggard · 2026-10-24
- Suspicious new GitHub accounts reference Qwen4 in Alibaba T-Head repo PRs — brainExploded99 · 2026-10-24
- Kimi K3.1 Pro takes on the pelican-on-a-bicycle 3D test: beats Opus 5, trails 5.5 — blaind0 · 2026-10-24