AI risk debate: capability-doom arguments skip the strategic interaction analysis
_onionesque · x · 2026-09-18
In a discussion on existential risk, @onionesques pushes back on arguments for unilaterally reducing one's own AI capability. While agreeing with most points (except the virus analogy), he argues current models are highly capable and on their own trajectories in many ecosystems, and that arguments jump from "capability is dangerous" to "cap ourselves" without analyzing strategic interaction. Even non-hostile model actions—bidding for land against agriculture or for energy in ways that crowd out human needs—could indirectly raise x-risk.
Related event: Debate over AI Existential Risk: Who Bears the Burden of Proof(7 posts)→
More from AGI Musings
- Investor: in the LLM era 'did it work' replaces diplomas and test scores — StewartalsopIII · 2026-11-04
- Should AGI labs have a reverse Conway's Law — design the org from the artifact? — akbirthko · 2026-11-04
- Verification Is Not Knowledge: Science needs more than AI answers — ersinesen · 2026-11-04
- Andreessen: Agents Are Entering Enterprises as Chaos, Just Like PCs and Spreadsheets Did — Dan_Jeffries1 · 2026-11-04
- 1000+ mathematicians sign pledge to shun AI companies and models — Shesawthat · 2026-11-04
- Von Neumann meme: "You don't have to be responsible for the world that you're in" — akbirthko · 2026-11-04