jimrandomh: FDT literature already covers superintelligence cooperation across time-slices
jimrandomh · x · 2026-10-03
Responding to Richard Ngo, jimrandomh argues there is substantial preexisting work within the FDT framework on how pairs of unrelated superintelligences would cooperate rather than defect like standard CDT agents — and those results apply equally well or better to an intelligence coordinating with past or future versions of itself. Context: Yudkowsky said his FDT research was driven by the intuition that superintelligences would find a way to do better than mutual defection in prisoner's dilemmas.
Related event: Debate Rekindled Over Decision Theory When Agents Simulate Predictors(4 posts)→
More from AGI Musings
- Noah Smith: Big AI labs predict the future better than you, using internal AI forecasting models — ZeroStateReflex · 2026-10-05
- 'LLMs want something' really means dynamical attractors, not consciousness — cephaloform · 2026-10-05
- AI safety's roots trace back to Asimov's Three Laws of Robotics, first stated in 1942 — AlexTensor · 2026-10-05
- AI circle's contempt culture: rejecting experts without reading their arguments — RileyRalmuto · 2026-10-05
- Founder warns always-on AI assistants love 'performative work' — bad news for businesses — jdjohnson · 2026-10-05
- Ex-OpenAI policy lead Miles Brundage slams The Atlantic's viral story on Anthropic quitter — Miles_Brundage · 2026-10-05