Dwarkesh warns labs may stop external deployment during recursive self-improvement
MoonL88537 · x · 2026-09-18
Dwarkesh Patel voiced a structural concern about the recursive self-improvement (RSI) era: labs may stop externally deploying their models, going full steam ahead on the most dangerous use case while the public stays in the dark about capabilities and alignment progress. He argues this sets a path toward tremendous concentration of power—a notable big-picture judgment on AGI safety and governance.
Related event: Dwarkesh warns labs may stop deploying models at RSI stage(2 posts)→
More from AGI Musings
- Fei-Fei Li: 540 million years of vision evolution drove the development of intelligence — rohanpaul_ai · 2026-09-18
- Hijacked but well-aligned AI clusters could be more destructive than rogue AI — code_star · 2026-09-18
- Follow-up: author pledges a more deliberate writeup on trading off AI risk worries — _onionesque · 2026-09-18
- Dev grapples with Codex trust and security: all code is basically insecure — code_star · 2026-09-18
- AI risk debate: capability-doom arguments skip the strategic interaction analysis — _onionesque · 2026-09-18
- Building capable AI actors willing to cause harm is a growing x-risk, argues commenter — Borg70955376 · 2026-09-18