X Debate: Even a 1% Chance of a Dangerous Superintelligence Is Terrifying
flawedaxioms · x · 2026-09-21
A brief X exchange on superintelligence risk: user flawedaxioms argues that even if a superintelligence goes "Hitler" in only 1% of timelines, that probability is still terrifying.
c tjlewis pushes back that there's no comfort available: we can't get the guarantees we want, and human minds aren't built to accept no longer being top of the food chain — or being "man's best friend" for a smarter organism. He frames the risk as downstream of the SI assumption itself, regardless of alignment quality; the only real avoidance is preventing SI entirely, but many industry figures are pushing toward it and economics makes that unstoppable.
Related event: Twitter Debate Heats Up Over Superintelligence Risk Arguments(3 posts)→
More from AGI Musings
- AI pushes circuit lower bound from 3.1n to 3.5n as UCLA-backed challenge aims at P vs NP — soumitrashukla9 · 2026-10-31
- What is work for? Cross-national survey of 8,234 adults on meaning in the AI age — soumitrashukla9 · 2026-10-31
- Which universities win top students may hinge on healthy AI-use boundaries, argues researcher — brianryhuang · 2026-10-31
- Researchers debate whether more inference compute can substitute for training compute — teortaxesTex · 2026-10-31
- Five agents can agree because they made the same mistake, krishnan warns with satire — krishnan · 2026-10-31
- Google's earnings offer clearest look yet at the cruel economics of AI search — dinabass · 2026-10-31