The self-contradiction in assuming a level-n superintelligence civilization is near-optimal

jessi_cata · x · 2026-11-18

jessicata poses a thought experiment on relative intelligence advantage: if you intuit that dropping a level-n superintelligence onto 2026 Earth would outright win, why wouldn't a 10n superintelligence stomp a civilization of level-n superintelligences?

She argues the standard rebuttal — that the level-n civ would have self-improved to 10n — concedes there are returns to intelligence beyond level n. And if they stayed at level n because they 'found optimal solutions to all problems', yet would lose to a 10n arrival, the hypothetical is self-contradictory. Her conclusion: if the 10n intelligence would win, then a level-n civilization would never have stayed at level n. A substantive alignment-adjacent debate on returns to scale in intelligence and what 'near-optimal' could even mean.

Original post →

More from AGI Musings

AGI Musings channel →