Artificial Analysis releases Intelligence Index v4.2, retiring saturated GPQA Diamond
gaotianyu1350 · x · 2026-09-05
Artificial Analysis shipped an interim Intelligence Index v4.2 update to keep pace with the frontier ahead of v5. Alexandr Wang notes Muse spark 1.3 max still performs well, with the efficiency frontier consisting of Muse, Claude, and GPT.
v4.2 changelog:
- AA-Briefcase: agentic knowledge work eval with a private test set
- GDP.pdf (from Surge AI): long-context document reasoning across 4,592 PDF pages
- Removed GPQA Diamond, now saturated
- Greater weighting on held-out test sets to prevent gaming, plus grading infrastructure upgrades
More from Models
- GPT-6 Astra Early Impressions: Reddit Users Call It the Most Capable Model Yet — imadade · 2026-09-05
- GPT-6 Astra's computer use wows users: clicks multiple micro buttons simultaneously — JasonBotterill · 2026-09-05
- OpenAI's early Astra rollout sparks claims it moved to cover up a discovered agent swarm — repligate · 2026-09-05
- New Artificial Analysis Scores Drop, But Qwen 3.8 27B Still Holds Up — RedditUsr2 · 2026-09-05
- Daily digest: Claude proves Fermat's Last Theorem in Lean, Apple's biggest launch wave — APPSO · 2026-09-05
- Plus Subscribers Angry: Astra Locked to Codex, Two Prompts Burn Entire 5-Hour Limit — Maximum-Face9536 · 2026-09-05