Combining multi-agent objectives with single-agent action space breeds disempowerment

j_foerst · x · 2026-11-13

jfoerst argues that pairing a multi-agent objective (e.g. 'number of humans alive ever') with a single-agent action space — where one actor optimizes at the margin treating everything else as given — is a self-fulfilling recipe for disempowerment: the framing itself erodes individual causal influence over the collective outcome.

Original post →

More from AGI Musings

AGI Musings channel →