Bostrom-Style Superintelligence Risks Remain Unresolved
jd_pressman · x · 2026-07-19
The post centers on Nick Bostrom's superintelligence risk discussion, arguing that judgments like "if no one builds it, everyone dies" show the problem is not closed. The author further emphasizes: even if jailbreaks mean models cannot be blindly used as perfectly reliable 1:1 systems, it doesn't mean the alignment problem is solved; it is merely one of the earliest and hardest hurdles outlined in Bostrom 2014.
Related event: Debate Rekindles Over AI Value Loading and Old Doom Models(4 posts)→
More from AGI Musings
- Robin Hanson says U.S. inventions have become less alike over two centuries — sebkrier · 2026-07-21
- Gary Marcus-backed “CERN for AI” pitch calls for an international frontier-model watchdog — GaryMarcus · 2026-07-21
- A Gyges-law quote argues future AI debates may hinge on whether people trust the proof — mimi10v3 · 2026-07-21
- The future is individuals shaping the world through small businesses with AI — tobowers · 2026-07-21
- An AI skeptic says the technology is useful, but overuse, copyright abuse and bad incentives are real risks — ZeroStateReflex · 2026-07-21
- Tyler Cowen says the future will be built by teenage “AI maniacs” — Polymarket · 2026-07-21