METR's new TH2 eval: capability doubling time shrinks to 1.65 months, could saturate by July 2027

josogood · reddit · 2026-11-21

METR's November 2026 update introduces TH2, a robust successor to its saturated time-horizon benchmark, measuring judgment and hard-to-verify tasks for models released through Sept 2026. Key findings: verified-task doubling time tightened from 3.07 to 1.65 months; parts of TH2 could saturate by July 2027. Models excel at coding/math but lag humans on costly tasks and judgment without empirical feedback; tested coverage tops out at Opus 5.5 / GPT-6 Astra.

Related event: METR Update: AI R&D Capabilities Rising Fast and Getting Harder to Measure(5 posts)→

Original post →

More from AGI Musings

AGI Musings channel →