METR's New Capability Chart Sparks Debate Over Leaked AECI Benchmarks

METR's new capability trend chart has sparked debate, with commenters noting it leaked details of three AECI benchmark components. While internal reactions to the benchmarks are not scientific evidence, some argue they should not be dismissed as zero evidence either.

2026-11-06 ~ 2026-11-06 · 2 related posts

• On the METR graph: insiders seeing AECI tasks is weak evidence, not zero evidence — gleech · 2026-11-06
• On METR's new graph: leaked AECI benchmarks are the usual weaksauce, but insiders are freaked out — gleech · 2026-11-06