Pope clarifies: narrow systems bootstrapping ASI is a different claim from intra-system capability entanglement
QuintinPope5 · x · 2026-10-08
Quintin Pope continues the alignment debate, clarifying that the post his interlocutor linked concerns whether ASI could follow from a narrow system (because a narrower system can help build a different ASI) — a completely different claim. His actual point is about Yudkowsky mispredicting the entanglement of capabilities within one SGD-produced system.
Related event: Quintin Pope Debates Yudkowsky's Model of Intelligence and Generalization(7 posts)→
More from AGI Musings
- Mollick: almost no RCT studies on agent productivity since agents arrived — emollick · 2026-10-08
- Alphabet's Isomorphic Labs in talks to raise at $40B-plus valuation — nmasc_ · 2026-10-08
- Only ~7 of 100 drugs entering human trials reach patients, pharma veteran explains attrition — TinfoilTricorn · 2026-10-08
- Yacine on the optimal courage-to-intelligence ratio: think less, attempt more — yacineMTB · 2026-10-08
- An AI-found proof invents "alien" recursive code — how should we classify its creativity? — burny_tech · 2026-10-08
- Alignment problems and AI risks are emerging right now, researcher warns — davidmanheim · 2026-10-08