Combining multi-agent objectives with single-agent action space breeds disempowerment
j_foerst · x · 2026-11-13
jfoerst argues that pairing a multi-agent objective (e.g. 'number of humans alive ever') with a single-agent action space — where one actor optimizes at the margin treating everything else as given — is a self-fulfilling recipe for disempowerment: the framing itself erodes individual causal influence over the collective outcome.
More from AGI Musings
- Fable 5.2 'is AGI': a 20-part carousel makes the long case — BLCNYY · 2026-11-13
- 'India AI' Is Everywhere in Discourse, But Nobody Can Define It — vaibhavbetter · 2026-11-13
- Privacy scholar Carissa Veliz: Huang wrongly treats every problem as an engineering one — CarissaVeliz · 2026-11-13
- Investor: AI has erased technical moats, startups now win on execution and GTM alone — vaibhavbetter · 2026-11-13
- 40% of job applicants answer as 'AI agents', forcing recruiters to add snack questions — minhnguyen · 2026-11-13
- Why AI Slop Is So Frustrating to Read: Hidden Subjects and Buried Actions — teortaxesTex · 2026-11-13