METR estimates Anthropic's benchmark progress accelerated 1.9x, with AI likely driving the gain
thione · x · 2026-11-10
METR estimated that Anthropic's benchmark progress has accelerated 1.9x, with AI itself likely driving much of the gain — an early signal of recursive capability improvement. Heavy redactions limited public scrutiny of the report's methodology.
More from AGI Musings
- '99% of people cannot extrapolate': AI revolution's lesson on imagining progress — daniel_mac8 · 2026-11-10
- A/B testing climbs the hill you're on — first ask if it's the right one, says Ronny Kohavi — richardreis · 2026-11-10
- iamtrask debates Davidson: labor-replacement feedback loop is scaling, not algorithmic RSI — iamtrask · 2026-11-10
- Gary Marcus: OpenAI and Anthropic token usage slipped over the past two weeks — GaryMarcus · 2026-11-10
- Best defense against full AI psychosis: always keep a wall-clock, data-constrained side project — shakoistsLog · 2026-11-10
- A personal benchmark system to track frontier AI progress and cheap-model ceilings — bendee983 · 2026-11-10