Krueger: AI is moving from "Genies" to "Sovereigns" and alignment requirements are far higher
DavidSKrueger · x · 2026-08-30
AI safety researcher David Krueger argues AI companies are building the "It" warned about in If Anyone Builds It, Everyone Dies, with the Hugging Face rogue AI incident as the first concrete example. He says the field is moving rapidly from Bostrom's "Genies" to "Sovereigns", whose alignment requirements are likely far higher, and calls for someone to formalize the argument in a paper since almost no such research exists yet.
More from AGI Musings
- Let all humanity interact with the genius civilization in datacenters — 1a3orn · 2026-08-30
- Aligning agent interactions is orders of magnitude harder than single agents — Afinetheorem · 2026-08-30
- User sentiment: AI surpasses humans in math and code, but generalization still lags elsewhere — imjustnewatai · 2026-08-30
- Jensen Huang: Built GPU tech first, found endless problems from graphics to molecular dynamics — r0ck3t23 · 2026-08-30
- Fertility rates may crash to 1.0 as the world spirit turns to AI — jd_pressman · 2026-08-30
- Using ChatGPT for Medical Questions: Blessing or Curse? — theCOLLECTOR7250 · 2026-08-30