Artificial Analysis overhauls Intelligence Index, widening open vs. closed model gap
The Decoder · rss · 2026-10-28
The Decoder reports that Artificial Analysis overhauled its Intelligence Index, and under the new methodology the gap between open and closed models widens noticeably. Kimi K3.1 Pro dropped five spots in the rankings. The revamp has sparked discussion about how benchmark methodology changes affect the relative standing of open-weight versus closed models.
More from Models
- Grok Bot on Windows plagued by flashing messages, bot spam and voice issues — IndraVahan · 2026-10-30
- Altman: OpenAI Almost Ditched Token Pricing for an AWS-Style Bill, Users Refused — menhguin · 2026-10-30
- User math: $1 of Son costs 7x Opus on $20 plan, but tasks only 1.3x — alvelda · 2026-10-30
- Claude gets the right answer but can't prove time complexity — geoffreyirving · 2026-10-30
- Healthcare company's ops team burns 1.2B Opus tokens in a single day — RishabJainK · 2026-10-30
- Kimi K3.1 Pro leak teases open weights by Nov 4, 2026 as progress index reportedly tops Fable 5 — teortaxesTex · 2026-10-30