Researcher warns automating AI R&D is the most dangerous tech development ahead
S_OhEigeartaigh · x · 2026-09-28
S. Ó hÉigeartaigh highlights a paper on the automation of AI R&D, calling it the single most important and dangerous technological development underway: it accelerates capabilities in unpredictable ways, risks making AI systems more opaque, and reduces human researchers' bargaining power — while the external governance community remains unprepared. He quips that friends don't let friends do recursive self-improvement.
More from AGI Musings
- Hanson vs Yudkowsky debate: economics abstractions vs self-made frameworks, and the ems growth-mode bet — RichardMCNgo · 2026-09-29
- Humans are bifurcating: 98% becoming superintelligence's "pets", 2% giving up the human form — danfaggella · 2026-09-29
- Pachocki, Hinton, Bengio & Jack Clark co-author paper on AI R&D automation triggering intelligence explosion — birchlse · 2026-09-29
- AI czar David Sacks slams extinction 'hoax': 4.1% unemployment, doomer job forecasts flopped — DavidSacks · 2026-09-29
- AI doom is the same hysterical grift as campus DEI, argues Kevin Bass — kevinnbass · 2026-09-29
- Bill Gates: AI is an evolutionary event — an intelligent species already smarter than us — haider1 · 2026-09-29