Claude Sonnet 5.5 and GPT-6 Astra tie atop medical long-context leaderboard as cost gaps hit 80x
ArtificialAnlys · x · 2026-10-21
Artificial Analysis updated the cost analysis for its MLCR-AA medical long-context reasoning leaderboard: Claude Sonnet 5.5 (max with fallback) and GPT-6 Astra (max) tie for #1 at 41.7%, via opposite routes — Sonnet 5.5 leads completeness (64.8%, 60.9% accuracy) while GPT-6 Astra leads accuracy (95.6%, 42.2% completeness).
- The Pareto frontier on cost spans $0.006/task (GPT-6 Luna max) to $0.48 (Sonnet 5.5); priciest is Claude Fable 5.1 at $1.30/task for just 15.6%.
- Claude Haiku 5.5 (max) burns the most tokens (67k output/task, 2x Sonnet 5.5, 20x GPT-6 Astra) yet stays at $0.04/task, scoring 35.0%, above Claude Opus 5.5's 27.8% at $0.92.
- On the dual metric, Opus 5.5 hits 63.3% completeness at 37.2% accuracy, while GPT-6.1 Sol (max) hits 96.7% accuracy at 40.0% completeness.
More from Models
- Recursive's Flint: open local coding model hits 125+ tokens/s on a MacBook Pro — HeyAmit_ · 2026-10-22
- vLLM adds day-0 support for Flint: 500 TPS on a single GB200 — _rockt · 2026-10-22
- WIRED: Recursive's Flint shows AI-built AI is getting closer to real recursive self-improvement — cong_ml · 2026-10-22
- Dev Quips Argon Is Good Because It Adds Things You Never Asked For — andrew_n_carr · 2026-10-22
- XBOW built a full-chain Chrome exploit in 6 days with gpt-5.6-sol, earning Google's $250K first VRP bounty of 2026 — moyix · 2026-10-22
- Six months later, the best AI costs 20× less — Tgoc · 2026-10-22