METR: AI R&D capabilities improving fast but getting harder to measure

ben_j_todd · x · 2026-11-21

METR published its Q4 capability update covering models up to Opus 5.5 and GPT-6 Astra, focused on AI R&D-relevant capabilities. Key finding: capabilities are improving rapidly while measurement is getting harder. Pooled 50% time-horizon estimates are 40h (GPT-6 Astra) and 39h (Opus 5.5), with 95% CI upper bounds of 2645h and 1253h; METR assigns 5% odds horizons already exceed 1000 hours.

Related event: METR quarterly update: AI R&D capabilities double every 1.65 months on new benchmark(12 posts)→

Original post →

More from AGI Musings

AGI Musings channel →