OpenAI launches Astra for Law, self-reported bench beats GPT-6 Astra 90.0% vs 84.1%
ahelkky · x · 2026-09-18
Vals AI reports that OpenAI launched Astra for Law today, validated on the Vals Legal Research Bench.
- On OpenAI's self-reported runs, Astra for Law beats GPT-6 Astra with web search at every price point: 90.0% vs 84.1% weighted rubric and 53.7% vs 39.6% all-pass.
- Figures are vendor-reported; no independent verification yet.
Related event: OpenAI Launches Astra for Law, Bringing GPT-6 Astra to the Legal Industry(11 posts)→
More from Models
- 105 planted bugs benchmark: Unbiased's Pareto scores 30.7 for just $4.81 — PawelHuryn · 2026-09-18
- Jason Wei's Stanford talk: intelligence is becoming a commodity as adaptive compute takes off — dotey · 2026-09-18
- GPT-6-Astra beats Fable-5.1 at RollerCoaster Tycoon 2 in 3 hours, using 5x fewer tokens — scaling01 · 2026-09-18
- RL agents invent their own diagnostic renderings to ground code understanding, sparking RL scaling optimism — teortaxesTex · 2026-09-18
- Dev discovers Codex security hardening switched persistent agent sessions to per-message instances — RileyRalmuto · 2026-09-18
- Astra for Law posts big legal benchmark gains as Mollick asks if labs will eat every AI vertical — emollick · 2026-09-18