Scale AI releases HLE-Diamond, a refined Humanity's Last Exam; top model scores 60.6%
sandersted · x · 2026-09-24
Scale AI, working with CAIS, is releasing HLE-Diamond, a refined subset of Humanity's Last Exam built to more reliably measure frontier models.
- A year of review and community feedback went into refining the subset
- The top model tested scored 60.6% overall
- The team expects HLE-Diamond to carry signal for the next 6-12 months
Related event: CAIS Releases HLE-Diamond Benchmark, GPT-6 Astra Tops at 60.6%(3 posts)→
More from Models
- Opus 5.5 feels nerfed — user blames system prompt restrictions, not the model — oyacaro · 2026-11-12
- Grok Bot now auto-detects and blocks prompt injection hidden in web pages — heypearlai · 2026-11-12
- ChatGPT now links to brand homepages far more, reshaping brand-mention tracking — lilyraynyc · 2026-11-12
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12