GPT-6 Astra gains ~80 points on AA-Briefcase but regresses similarly on GDPval-AA v2
ArtificialAnlys · x · 2026-09-04
In its Intelligence Index v4.1.1 breakdown, Artificial Analysis found mixed progress for GPT-6 Astra on agentic knowledge work: the model improved roughly 80 points on AA-Briefcase — with big gains in rubric scores and Analytical Quality Elo, though Presentation Quality Elo dropped — while regressing by a similar margin on GDPval-AA v2, showing uneven progress across task dimensions.
Related event: GPT-6 Astra Reviews: Halved Hallucinations but 2.5x Price Hike(18 posts)→
More from Models
- OpenAI launches GPT-6 Astra, claiming it can do anything you do on a computer — kagigz · 2026-09-04
- Databricks evals: GPT-6 Astra claims SOTA on OfficeQA Pro benchmarks, cheaper per task — downingARK · 2026-09-04
- Mathematician tests GPT-6 Astra: live Lean proof verification while writing arguments — teortaxesTex · 2026-09-04
- Tavus Launches Sparrow-2, Claiming #1 in End-of-Turn Detection and Interruption Handling — ycombinator · 2026-09-04
- ARC-AGI-3: 10x reasoning tokens cuts total cost from $48k to $26k vs medium — i_dg23 · 2026-09-04
- Researchers flag data contamination concerns in benchmark behind Astra's time-horizon score — dfrsrchtwts · 2026-09-04