"Just Ban the Smarter-Than-Us Computer Aliens": A Intuitive Case for a Superintelligence Moratorium
AndyMasley · x · 2026-11-10
inerati argues that despite sounding like science fiction, "just ban the creation of the smarter-than-us computer aliens we don't know how to control" is actually a quite intuitive position once you get over the framing — though its viability depends heavily on how the next couple of years unfold. AndyMasley retweeted the take, in an ongoing debate about whether frontier AI development should be halted.
More from AGI Musings
- METR's redacted evidence 'significantly informed' its 2x finding — common criticisms misread the report — austinc3301 · 2026-11-10
- Is the 2x AI R&D speedup compounding? One year of data can't yet tell a level shift from an RSI loop — austinc3301 · 2026-11-10
- No diminishing returns in METR data: annual gains rose from ~23 to ~29 points, complicating RL-catchup theory — austinc3301 · 2026-11-10
- Testing the "RL catching up to bigger pretrains" hypothesis against METR timelines — austinc3301 · 2026-11-10
- Refitting all of METR's data yields ~1.6x AI capability acceleration, above Toby Ord's 1.4x — austinc3301 · 2026-11-10
- Three open questions on the ~2x AI R&D speedup: is it real, AI-driven, and compounding? — austinc3301 · 2026-11-10