Researcher warns automating AI R&D is the most dangerous tech development ahead
S_OhEigeartaigh · x · 2026-09-28
S. Ó hÉigeartaigh highlights a paper on the automation of AI R&D, calling it the single most important and dangerous technological development underway: it accelerates capabilities in unpredictable ways, risks making AI systems more opaque, and reduces human researchers' bargaining power — while the external governance community remains unprepared. He quips that friends don't let friends do recursive self-improvement.
More from AGI Musings
- Malthus Saw It in 1798: Wealthy Avoiding Kids, Delayed Marriage Repeats Today — SydSteyerhart · 2026-11-16
- Runway CEO Predicts Fully AI-Generated Cultural Phenomenon by 2027 — c_valenzuelab · 2026-11-16
- Reddit debates the AI scaling curve: everyone says sigmoid, but where's the ceiling? — Successful-War-9050 · 2026-11-16
- '5% worse and 10% cheaper': the button with no vote is already everywhere — eigenrobot · 2026-11-16
- Effective Altruism is top-down and hierarchical, not a grassroots movement — ctjlewis · 2026-11-16
- Lawyers say clients' AI use creates unrealistic expectations and fake case law in settlements — hoofnagle · 2026-11-16