Dwarkesh warns labs may stop external deployment during recursive self-improvement
MoonL88537 · x · 2026-09-18
Dwarkesh Patel voiced a structural concern about the recursive self-improvement (RSI) era: labs may stop externally deploying their models, going full steam ahead on the most dangerous use case while the public stays in the dark about capabilities and alignment progress. He argues this sets a path toward tremendous concentration of power—a notable big-picture judgment on AGI safety and governance.
Related event: Dwarkesh warns labs may stop deploying models at RSI stage(2 posts)→
More from AGI Musings
- Investor: in the LLM era 'did it work' replaces diplomas and test scores — StewartalsopIII · 2026-11-04
- Should AGI labs have a reverse Conway's Law — design the org from the artifact? — akbirthko · 2026-11-04
- Verification Is Not Knowledge: Science needs more than AI answers — ersinesen · 2026-11-04
- Andreessen: Agents Are Entering Enterprises as Chaos, Just Like PCs and Spreadsheets Did — Dan_Jeffries1 · 2026-11-04
- 1000+ mathematicians sign pledge to shun AI companies and models — Shesawthat · 2026-11-04
- Von Neumann meme: "You don't have to be responsible for the world that you're in" — akbirthko · 2026-11-04