Qwen4 Max scores 43 on AA Intelligence Index, 67% cheaper per task than predecessor
ArtificialAnlys · x · 2026-11-16
Artificial Analysis breaks down Alibaba's Qwen4 Max: it scores 43 on the Intelligence Index (+9 over Qwen3.8 Max, 3 behind Kimi K3.1 Pro's 46) at 11% lower cost per task.
- Across-the-board gains: HLE-Diamond +21 (24%→45%), AA-Omniscience +18, AutomationBench-AA +17, CritPt v2 +13, Terminal-Bench-Science +11, Terminal-Bench 4.0 +9; AA-Briefcase hits 1686 Elo, above Kimi K3.1 Pro (1674).
- Cost: $3.27/task vs $10.02 for Qwen3.8 Max and $3.68 for Kimi K3.1 Pro, driven by 25% lower pricing, 70% cheaper cache hits ($0.075), and 39% fewer output tokens (105k vs 171k). Tencent Hy4 costs $1.03 but scores 8 points lower.
- Weak spots: Terminal-Bench 4.0 at 48% (Kimi: 67%); FrontierCode 2.0 at 26%, behind Tencent Hy4 (31%).
- Specs/pricing: 1M context, text+image input; $1.50/$4.50 per 1M input/output tokens, $0.075 cache hits.
More from Models
- Qwen4 Max per-eval breakdown: strong on knowledge work, lagging in coding — ArtificialAnlys · 2026-11-16
- Qwen4-Max debuts at #14 on Agent Arena, making Alibaba the #5 lab overall — Alibaba_Qwen · 2026-11-16
- New MoE base claims win over Qwen3.8-Max with 50% fewer tokens, met with skepticism — teortaxesTex · 2026-11-16
- Qwen4-Max benchmarks leak: 50% fewer tokens, 60% cheaper — but 'you've hit a wall' — teortaxesTex · 2026-11-16
- Comparing AI censorship: Gemini preempts, Claude silently rewrites, OpenAI just blocks — ivan_bezdomny · 2026-11-16
- Qwen4-Max lands #6 on Code Arena WebDev, up 74 pts over Qwen3.8-Max — Alibaba_Qwen · 2026-11-16