The singleton motte-and-bailey: falling conflict costs vs. an AI light-years ahead
jessi_cata · x · 2026-11-17
jessicata argues there's a potential motte/bailey around AI singletons:
- Motte (defensible): the share of resources spent on conflict will decline over time, e.g. via welfare theorems and efficient wargaming
- Bailey (sold): a self-improving AI ends up light years ahead of any competition from civilization or other AIs
In a follow-up he quotes Scott Alexander's "Meditations on Moloch" (citing Bostrom's Superintelligence), where the speed of the self-improvement loop makes a single permanently dominant entity plausible — illustrating exactly the slide from the modest claim to the strong one.
Related event: Debate Flares Over the Case for a Friendly AI Singleton(3 posts)→
More from AGI Musings
- Would the first superintelligent AI find our consciousness obsession as quaint as medieval soul debates? — VraserX · 2026-11-17
- Debate: top AI labs hire for connections, but strong outsiders still break through — _dsevero · 2026-11-17
- Nina Schick links wave of outages to spreading AI zero-day capabilities — NinaDSchick · 2026-11-17
- AI-formalized math spans Galois's 1832 last letter, fixing errors in a dozen published papers — stevenstrogatz · 2026-11-17
- Vlad Tenev: OpenAI or Anthropic owning every AI discovery would be 'a bit dystopian' — No Priors · 2026-11-17
- Altman: trading human agency for cancer cures is a "terrible sales pitch" — TorturedPoet30 · 2026-11-17