AI Safety Researcher Argues a Global ASI Treaty Is Possible; Skeptics Push Back
davidmanheim · x · 2026-09-15
In an exchange with Luca DellAnna, davidmanheim outlines his plan for a global treaty managing ASI-race risks: argue publicly for it, show it aligns with everyone's incentives, and crucially, don't give up preemptively. DellAnnaLuca counters that negotiating with "bad guys" to stop won't work, and that "generally aligned, generally refuse" doesn't hold today—no argument shows scaling beyond human oversight makes AI safer. davidmanheim replies that winning a race to omnicide doesn't appeal to him, and letting bad actors scale freely doesn't reduce risk either.
More from AGI Musings
- Alpha School investigation: 17 campuses on probation, Bill Ackman as shadow lead, Holmes involved — benjaminjriley · 2026-11-02
- Google's chief economist: AI will transform more jobs than it kills — gains come from redesigning workflows — danielrock · 2026-11-02
- Daniel Lemire: AI is exploding demand for boring compute, server CPUs to double — lemire · 2026-11-02
- Alignment researcher: the word "aligned" implies consistencies that don't exist — davidmanheim · 2026-11-02
- By 2035, Indian Parents Will Ask How Many Agents You Manage, Not Your Salary — theteknosaur · 2026-11-02
- Under 5% of US consumers pay for AI, yet compute demand is already forcing usage cuts — NinaDSchick · 2026-11-02