METR: AI acceleration trend findings swing with methodology choices

CFGeek · x · 2026-11-21

METR's trend analysis of its index finds anything from slight deceleration to moderate acceleration depending on methodological choices, using only public models through September and thus not directly comparable to Anthropic's "2x acceleration on AECI" result. Appendix H details comparisons: MCI slope changes broadly match METR's October 2026 AI R&D Acceleration report under similar calibration, though usually lower than Anthropic's system-card figures; linked linear fits to IRT models are sensitive to calibration models, breakpoints, and benchmark choice. On public models up to Opus 5.5 and GPT-6 Astra, positive slope changes appear within Anthropic models but not OpenAI's.

Original post →

More from Research

Research channel →