Anthropic publishes three metrics tracking AI-driven R&D as Stanford lab builds the audit dashboard
erikbryn · x · 2026-09-18
- Anthropic officially released three measurements to track AI development: how much AI R&D is done by AI, how well AI agents are overseen, and how compute is allocated — with an internal snapshot, arguing any frontier lab could publish the same and third parties could verify them.
- A reply proposes labs adopt standard RSI-progress measures reported weekly/monthly, pointing to Stanford Digital Economy Lab's AI Economic Indicators as the natural audit platform — covering employment by AI exposure (Canaries, with ADP Research), macro signals (Transformation Tracker), adoption trends, and consumer surplus (GDP-B).
Related event: Anthropic Says Claude Now Does 26% of Its Own R&D(23 posts)→
More from AGI Musings
- Researcher Warns Life Sciences Verification Program Could Lock Down Biology, Urges Support for Open Models — anshulkundaje · 2026-09-18
- Brundage: AI Security Progress Lags Capability Gains—the Strongest Case for Slowdown — Miles_Brundage · 2026-09-18
- Miles Brundage: Preventing AI Theft and Tampering Is the Top Policy Priority — Miles_Brundage · 2026-09-18
- whurley cites BitWhisper paper to debunk Noam Brown's air-gap attack fearmongering — whurley · 2026-09-18
- Karpathy: model generations last 3-4 months, so predicting 2 years out is hopeless — deedydas · 2026-09-18
- Noam Brown: air-gapping may not stop misaligned AI; Grady Booch mocks the claim — GaryMarcus · 2026-09-18