METR Q4: $90k of expert humans still can't beat frontier models, horizons hit 27h

iruletheworldmo · x · 2026-11-21

METR's Q4 update: the org paid $90k at $200–350/hr to experts (including a Codeforces grandmaster and an ARC-AGI winner) yet couldn't find humans to beat frontier models on multi-month optimization contests — models rank 96th–98th percentile. Task-completion time horizons hit 27 hours, doubling every 3.6 months, and per the attached chart this only covers Opus 5.5 / GPT-6 Astra — newer Fable 5.2, GPT-6.2 and Gemini 4 Neon are unmeasured. FrontierMath T4 (Astra): 98%; MirrorCode (Opus 5.5): 77%. The poster's take: "slowdown? What slowdown."

Related event: METR Quarterly Update: AI R&D Capabilities Double Every 3.6 Months and Are Getting Harder to Measure(8 posts)→

Original post →

More from AGI Musings

AGI Musings channel →