AGI as Unpredictable Multi-Agent Systems: The Need for New Constraints
sebkrier · x · 2026-08-22
Nate Witkin highlights Séb Krier's argument against the 'omniscient genie' model of AGI, suggesting instead a future dominated by millions of semi-reliable, sub-AGI agents. The discussion emphasizes that human institutions rely on incentives (like firing or promotion) which agents currently lack, making behavior constraint difficult. As we enter a multi-agent world, better harnesses, protocols, and mechanism design are deemed critical for safety.
More from AGI Musings
- AI improving 'without humans' is complete nonsense: RSI, AGI, and ASI are just buzzwords — JosephJacks_ · 2026-08-22
- Fallacy: AI can code, so businesses don't need to pay for software — gdechichi · 2026-08-22
- US Corporate Early-Stage R&D Declines Despite AI Boom — Afinetheorem · 2026-08-22
- Ben Goertzel on Big Tech's Bets and AI Economic Structures — bengoertzel · 2026-08-22
- As Multi-Agent World Arrives, Experts Call for New Governance Design — soumitrashukla9 · 2026-08-22
- AI shrinks skill half-life, pushing learning market from watching to doing — DavidLinthicum · 2026-08-22