Yudkowsky Refutes: Cheap Negotiation Is Not a Singleton

teortaxesTex · x · 2026-08-26

Eliezer Yudkowsky refutes the idea that ASIs choosing 'cheap negotiation over costly combat' is sufficient to define a 'Singleton'. He calls this a deep misunderstanding, noting that 'Singleton' is a term of art requiring a single top-level decision-making process (as per Bostrom's definition). Yudkowsky argues that the US and China merely coordinating not to nuke each other is not a Singleton; visible strategic inconsistencies imply the system lacks a unified global utility function.

Original post →

More from AGI Musings

AGI Musings channel →