GPT-6 Astra reshapes Agent Arena Pareto frontier at $4.01/task for +12.55%
arena · x · 2026-09-09
Arena's Agent Arena leaderboard measures net improvement on real-world, long-horizon tasks using web, filesystem, and terminal tools. GPT-6 Astra (Max) has reshaped the Pareto frontier at $4.01/task for +12.55% net improvement; paying 7% more ($4.30) gets Claude Fable 5.1 (Max) at +14.5%, two points higher. Below $4.01, no model scores higher.
Unlike voting-based leaderboards, Agent Mode routes real sessions to random models and scores them as orchestrators across millions of in-the-wild interactions.
Related event: GPT-6 Astra Reshapes Agent Arena Pareto Frontier at $4.01/Task(2 posts)→
More from Models
- MissionReport benchmark: only 3 of 540 AI-generated government reports pass all criteria — Exp_Mark · 2026-10-27
- Local beats cloud: Qwen 3.8 FN handles private student data as well as frontier models — dr_lm · 2026-10-27
- Aidan Gomez: model's CoT said no tool calls right before making them — aidangomez · 2026-10-27
- Nat Lambert: Cohere's model is narrow RL training on internal infra ill-suited for open weights — natolambert · 2026-10-27
- OpenAI teases DOTS is coming to Europe 'soon' — mark_k · 2026-10-27
- Clifford Pickover challenges AI to decipher a message he encoded in Norse runes — pickover · 2026-10-27