Kimi K3.1 Pro hands-on: strong benchmarks, underwhelming real-world use
lyraxana · x · 2026-10-24
A user who has been using Kimi K3.1 Pro for a while reports that real-world performance falls short of its impressive benchmark results, though it improves on K3 by no longer overthinking every request.
The firsthand account contrasts with the model's strong official scores — another reminder of the gap between benchmarks and actual usage.
More from Models
- Kimi k3.1 pro aces the pelican-bike test in 45 minutes; author calls benchmark saturated — ChrisGPT · 2026-10-24
- urllib3 maintainer rejected by OpenAI's Cyber Verification Program: form is offensive-researcher only — matthew_d_green · 2026-10-24
- Mubit open-sources Banyan Sapling, a verification model with calibrated probabilities (Apache 2.0) — testingcatalog · 2026-10-24
- 105 planted bugs tested: Kimi K3.1 Pro scores 36, loses on cost-effectiveness — PawelHuryn · 2026-10-24
- Kimi K3.1 isn't an Opus-class model, says investor ahead of detailed benchmarks — bindureddy · 2026-10-24
- Baseten: Mirendil-Base-Large posts lowest perplexity on unseen private code — baseten · 2026-10-24