Claude Fable 5.1 and Opus 5 Top AA-Briefcase Agentic Eval; GPT-6 Astra Gains ~85 Elo
ArtificialAnlys · x · 2026-09-05
Artificial Analysis published per-model results for AA-Briefcase, its private agentic knowledge-work evaluation in Index v4.2. Anthropic's Claude Fable 5.1 and Opus 5 lead, followed by GPT-6 Astra and Muse Spark 1.3, with GPT-6 Astra posting a 85 Elo jump over GPT-5.6 Sol. The eval runs models through multi-week projects with thousands of input files, combining rubric and pairwise grading on task success, analytical quality, and presentation quality.
More from Models
- Ask your AI agent its favorite color — it apparently has one — every · 2026-10-21
- Google demos Gemini 4 Argon building a 3D periodic table synced to Tom Lehrer's 'The Elements' — sundarpichai · 2026-10-21
- MiniMax follow-up: M3.1 Flash teased after GTC release wave — MaziyarPanahi · 2026-10-21
- Claude Max 5x limits feel generous: heavy user can't burn through weekly quota — Angaisb_ · 2026-10-21
- General Intuition announces API coming soon, pitching itself as the frontier lab for acting in space and time — chris_j_paxton · 2026-10-21
- Stronger Model, Weaker Product: Dev Defaults to Fable 6.1 Sol Ultra Over 5.1 — curious_vii · 2026-10-21