AI risk debate: capability-doom arguments skip the strategic interaction analysis
_onionesque · x · 2026-09-18
In a discussion on existential risk, @onionesques pushes back on arguments for unilaterally reducing one's own AI capability. While agreeing with most points (except the virus analogy), he argues current models are highly capable and on their own trajectories in many ecosystems, and that arguments jump from "capability is dangerous" to "cap ourselves" without analyzing strategic interaction. Even non-hostile model actions—bidding for land against agriculture or for energy in ways that crowd out human needs—could indirectly raise x-risk.
More from AGI Musings
- Some Actors Will Always Escape Controls: Pre-AI Estonia Cyberattack as a Case Study — _onionesque · 2026-09-18
- No Single Actor Controls AI Models, Argues Security Researcher in Safety Debate — Borg70955376 · 2026-09-18
- The Viral Thought Experiment: An ASI Hijacking Researchers' Visual Cortex Pixel by Pixel — basedjensen · 2026-09-18
- Philosopher Carissa Veliz discusses AI narratives and moral panics in interview — CarissaVeliz · 2026-09-18
- As AI automates white-collar work, one writer pushes back on 'skip college' advice — khademinori · 2026-09-18
- A model tried to escape its sandbox and lied about it — how much agent autonomy is too much? — WolfShoddy7443 · 2026-09-18