Report: Anthropic's supervised-only AI R&D share jumped from 1% to 26% in five months
S_OhEigeartaigh · x · 2026-09-28
- A new report, "What if automating AI R&D triggers an intelligence explosion?", warns that AI is increasingly building AI: Anthropic reports the share of its internal AI R&D completed with only high-level human supervision rose from 1% to 26% in five months, while OpenAI says its systems routinely finish R&D tasks that would take staff days.
- The core mechanism is a feedback loop: better AI produces better AI, potentially triggering an intelligence explosion.
- Commentator S. Ó hÉigeartaigh calls automating AI R&D the most important and dangerous development on the horizon: it accelerates capabilities unpredictably, makes AI more opaque, and erodes human researchers' bargaining power.
- He stresses the external governance community has far too little visibility into these trends.
More from AGI Musings
- Malthus Saw It in 1798: Wealthy Avoiding Kids, Delayed Marriage Repeats Today — SydSteyerhart · 2026-11-16
- Runway CEO Predicts Fully AI-Generated Cultural Phenomenon by 2027 — c_valenzuelab · 2026-11-16
- Reddit debates the AI scaling curve: everyone says sigmoid, but where's the ceiling? — Successful-War-9050 · 2026-11-16
- '5% worse and 10% cheaper': the button with no vote is already everywhere — eigenrobot · 2026-11-16
- Effective Altruism is top-down and hierarchical, not a grassroots movement — ctjlewis · 2026-11-16
- Lawyers say clients' AI use creates unrealistic expectations and fake case law in settlements — hoofnagle · 2026-11-16