Kimi K3.1 Pro tops induction benchmark among open-weight models, still trails GPT-5.6 Sol
teortaxesTex · x · 2026-10-24
A rare third-party eval where Kimi K3.1 Pro shines: on the Induction Challenge (Holdouts v2) it ties with or surpasses Opus 5 and is well ahead of Qwen 3.8 Max and Muse Spark 1.3, making it the top open-weight model on the leaderboard. It ran with MAX reasoning and a 500K-token completion cap including thinking. Caveats: it remains well below GPT-5.6 Sol, GPT-6.1 Sol and Opus 5.5, so not frontier yet — and given its token usage it costs more than GPT-6.1 Sol. Scoring is strict: missing, erroring, empty, truncated or unparseable outputs all count as incorrect.
More from Models
- Scale CEO teases new models as users say Muse Wonder Full is underrated — alexandr_wang · 2026-10-24
- Canva Craft trained on millions of templates and 25,000 designer-evaluated image pairs — jacob_top · 2026-10-24
- $34.72 of Kimi K3.1 Pro tokens builds a playable Spider-Man Manhattan in 8 hours — sven_ai · 2026-10-24
- Cisco engineer replicates free Antares security model at ~80% of official score — shashib · 2026-10-24
- Kimi K3.1 vs Opus 5.5: 80% Cheaper and 4x Faster on Same Task — sven_ai · 2026-10-24
- Claim: Open-source Kimi K3.1 Pro beats OpenAI's GPT-6-Astra, unverified — sven_ai · 2026-10-24