Effort settings now swing scores 20+ points at 10x cost, AA v5 finds
ArtificialAnlys · x · 2026-10-28
Effort settings matter far more in v5: Claude Opus 5.5 scores 35 at low effort and 58 at max, at 10x the per-task cost ($0.98 vs $10.04). Claude Sonnet 5.5 spans 29 points from low to max (up from 20 in v4.3), and GPT-6.1 Sol's spread doubled from 10 to 20 points. Choosing the right effort tier is now a major cost/capability decision.
More from Models
- YacineMTB rails: even the best LLMs are 'complete dogshit' and he's tired of it — yacineMTB · 2026-10-28
- Omni-InteractScope benchmarks proactive interaction in continuous omnimodal streams — Qwen · 2026-10-28
- Mistral releases Timestral time-series foundation models, tops GIFT-Eval — mistralai · 2026-10-28
- Gemini 4 Argon Hits 1.73% WER on OCR Benchmark, Surpassing Human Experts — gabriberton · 2026-10-28
- Meta's Omnilingual MT covers 1,600 languages, 1B–8B models rival 70B LLMs — kalyan_kpl · 2026-10-28
- Uncensored LFM3-1.7B GGUF weights released on Hugging Face — kalyan_kpl · 2026-10-28