Qwen4 Max per-eval breakdown: strong on knowledge work, lagging in coding

ArtificialAnlys · x · 2026-11-16

Artificial Analysis publishes per-evaluation charts for Qwen4 Max across all 9 Intelligence Index evals. Highlights: AA-Briefcase (agentic knowledge work on real business files) at 1686 Elo, near the top; AA-Omniscience accuracy 44% with markedly improved hallucination rate; AutomationBench-AA 73%. Weak spots remain: Terminal-Bench 4.0 at 48%, Terminal-Bench-Science 22%, FrontierCode 2.0 26% — coding and terminal tasks still trail frontier leaders. HLE-Diamond 45%, CritPt v2 43%, GDP.pdf 29%.

Original post →

More from Models

Models channel →