Artificial Analysis releases Intelligence Index v4.2, retiring saturated GPQA Diamond
gaotianyu1350 · x · 2026-09-05
Artificial Analysis shipped an interim Intelligence Index v4.2 update to keep pace with the frontier ahead of v5. Alexandr Wang notes Muse spark 1.3 max still performs well, with the efficiency frontier consisting of Muse, Claude, and GPT.
v4.2 changelog:
- AA-Briefcase: agentic knowledge work eval with a private test set
- GDP.pdf (from Surge AI): long-context document reasoning across 4,592 PDF pages
- Removed GPQA Diamond, now saturated
- Greater weighting on held-out test sets to prevent gaming, plus grading infrastructure upgrades
More from Models
- Ask your AI agent its favorite color — it apparently has one — every · 2026-10-21
- Google demos Gemini 4 Argon building a 3D periodic table synced to Tom Lehrer's 'The Elements' — sundarpichai · 2026-10-21
- MiniMax follow-up: M3.1 Flash teased after GTC release wave — MaziyarPanahi · 2026-10-21
- Claude Max 5x limits feel generous: heavy user can't burn through weekly quota — Angaisb_ · 2026-10-21
- General Intuition announces API coming soon, pitching itself as the frontier lab for acting in space and time — chris_j_paxton · 2026-10-21
- Stronger Model, Weaker Product: Dev Defaults to Fable 6.1 Sol Ultra Over 5.1 — curious_vii · 2026-10-21