Could alignment researchers parlay a practical NP oracle into a pivotal act?
jessi_cata · x · 2026-09-10
Responding to a joke about the world ending from P=NP before ASI takes over, jessicata poses a serious sci-fi thought experiment: if elite agent-foundations-style alignment researchers secretly got hold of a practical NP oracle, could they parlay it into a pivotal act, existential safety, or at least set GPU status to melted?
It's a classic AI-risk-circle thought game combining computational complexity breakthroughs with the concept of a single decisive move to solve alignment or cap compute.
More from AGI Musings
- Greg Egan's 1995 AI classic 'Learning To Be Me' resurfaces as free full-text — ZeroStateReflex · 2026-09-10
- AI won't kill everyone: blogger rounds up essays arguing doom debate targets wrong threats — binarybits · 2026-09-10
- tszzl mocks Tegmark IV doomsayers: 'Platonic entities are welcome in my backyard' — tszzl · 2026-09-10
- Programmed love still feels real: an analogy in the AI companionship debate — MajmudarAdam · 2026-09-10
- AI-run interviews reveal a split: childfree cite freedom, would-be parents cite cost — soumitrashukla9 · 2026-09-10
- Cambridge prof David Krueger puts AI catastrophe risk above 50%, says everyone is understating it — KatjaGrace · 2026-09-10