Agent Arena leaderboard: GPT-6 Astra costs $3.94/task for a 11.7% edge over cheaper models
arena · x · 2026-09-17
Agent Arena published an agent performance leaderboard comparing each model family's top model by net improvement score and median cost per task.
Key findings:
- GPT-6 Astra (Max): +11.7% improvement at $3.94/task
- GPT-5.6 Sol (xHigh): +7.0% at $1.03/task
- GPT-6 Astra and Claude Fable 5.1 stand out for costing far more than sibling models despite relatively close performance
Full rankings available on the Agent Arena site.
Related event: Agent Arena: GPT-6 Astra Costs Double for Modest Gains(2 posts)→
More from Models
- Gemini 4 'Argon' swag box from Google DeepMind surfaces, teasing next-gen model — kimmonismus · 2026-11-02
- Nanbeige4.3-33B lands on Hugging Face, pitched as a Qwen rival — amaarora · 2026-11-02
- r/LocalLLaMA Proposal: Private Quality Benchmarks Over Endless tok/s Chasing — Express_Quail_1493 · 2026-11-02
- A4 print-ready PDF stress test: only Claude, Gemini and Mistral pass out of 10 AI models — gerardsans · 2026-11-02
- Discounted API relay stations lack prompt caching, making long sessions pricier — uneatenbreakfast · 2026-11-02
- Google open-sources EmbeddingGemma 2: on-device multimodal search across photos, audio, docs — bigaiguy · 2026-11-02