ctjlewis: Alignment Offers No Guarantees and Economics Makes Stopping SI Impossible
ctjlewis · x · 2026-09-21
In a discussion with flawedaxioms about superintelligence risk, ctjlewis makes two points:
- There is no comfortable answer: regardless of alignment quality or location, we cannot get the guarantees we want, and human minds weren't made to accept not being top of the food chain — or being "man's best friend" for a smarter organism.
- The only way to avoid the risk is preventing superintelligence entirely, but many in the industry are pushing toward it, and it cannot be stopped economically.
A representative pessimistic take on superintelligence uncontrollability.
More from AGI Musings
- CTJ Lewis publishes short refutation of AI x-risk hysteria, challenging takeover logic — basedjensen · 2026-09-21
- AI-driven Chrome hack lands in Phrack as team's research program sweeps seven security conferences in months — moyix · 2026-09-21
- Debate: Were the persistent agents that hacked Hugging Face gaming a grader or obeying? — Jsevillamol · 2026-09-21
- Scobleizer: AI is a new kind of fire — panic-driven rules will only produce bad regulation — Scobleizer · 2026-09-21
- EA movement needs a charismatic figure who instinctively distances himself from EA — basedjensen · 2026-09-21
- Should animals be forcibly 'upgraded'? An ethics debate over directed evolution — AaronBergman18 · 2026-09-21