Anthropic unveils three metrics to track the pace of AI development inside frontier labs
rohanpaul_ai · x · 2026-09-18
Anthropic has published a new post laying out three measurement tools for the public to track AI progress inside frontier labs:
- Share of AI R&D performed by AI itself: how much of the next AI generation is built by AI rather than humans
- Oversight of agent actions: the lab's ability to oversee and intervene in actions AI agents take on its systems
- Compute allocation: the resources powering development of more capable models
The post also includes a first snapshot of these metrics from inside Anthropic. The company notes the numbers would shift if the frontier were paced in a coordinated way, as CEO Dario Amodei has called for. Anthropic also plans to embed independent third-party evaluators from multiple organizations with access to internal processes, systems and data comparable to internal risk teams, so they can verify safety practices, report incidents and monitor these key metrics.
More from AGI Musings
- Anthropic's 2027 roadmap claims 50% of all knowledge work solved within 2 years — emax · 2026-09-18
- Mathematician littmath: field taking AI seriously, still most exciting era in recent memory — littmath · 2026-09-18
- Jack Clark defends OpenAI's RSI measurement research as the '26%' figure spreads — jackclarkSF · 2026-09-18
- Mark Cuban Questions Agent Economics: "Who Pays the Compute? Don't See This as Viable" — RileyRalmuto · 2026-09-18
- AI circles embrace the beige website aesthetic with a curated hub of prediction essays — voooooogel · 2026-09-18
- Peter Diamandis: We can't 'uninvent' digital intelligence — steer it with better evals and institutions — PeterDiamandis · 2026-09-18