HLE-Diamond: Claude Opus 5.5 leads at 68% as knowledge questions stump frontier models
ArtificialAnlys · x · 2026-10-28
Artificial Analysis details HLE-Diamond, which replaces Humanity's Last Exam in its Index: the refined 1,000-question version from CAIS and Scale AI, split evenly between reasoning and knowledge. Claude Opus 5.5 (max) leads at 68%, GPT-6 Astra (max) at 64%, Claude Fable 5.1 (max) at 60%.
A notable structural finding: reasoning is easier than knowledge for leaders — Opus 5.5 and GPT-6 Astra both score 78% on reasoning versus 58% and 50% on knowledge.
More from Models
- Debate: Claude isn't 'lobotomized' — inference stack updates may shift old-model outputs — JasonBotterill · 2026-10-28
- AI labs near IPO, yet LLMs still produce 'astonishingly terrible prose' by default — GabGarrett · 2026-10-28
- Rebuttal: Kimi 3.1 Nears Fable on Frontier Code 2, Contradicting 'China Models Crushed' Claim — bookwormengr · 2026-10-28
- Open model Flint hits #2 trending on Hugging Face, team outlines next steps — josh_tobin_ · 2026-10-28
- Artificial Analysis Intelligence Index v5 widens open-weight gap from 3 to 12 points — ResearchCrafty1804 · 2026-10-28
- YacineMTB rails: even the best LLMs are 'complete dogshit' and he's tired of it — yacineMTB · 2026-10-28