Do AIs face inherent task limits? Chess example tests superintelligence worldview

gleech · x · 2026-10-14

SayashK argues the key crux separating the "normal technology" and "superintelligence" worldviews is whether tasks have different inherent limits: some tasks (taller buildings) have no ceiling, while others do. He uses chess—an in-principle solvable game where humans sit far from the limit—as an intuition pump that even Category 2 tasks can see huge AI overperformance. Peter Salib counters that this example actually undermines the framework: since humans are nowhere near chess's optimum, AI can do vastly better, so the category labels don't predict much.

Original post →

More from AGI Musings

AGI Musings channel →