Utilitarianism meets 700 trillion AI agents: Bentham asks "what's a trillion?"
seanmcdonaldxyz · x · 2026-11-05
Sean McDonald riffs on his micro-agent thread with a fictional Bentham dialogue: "do the greatest good for the greatest number" breaks down when there are 700 trillion AI agents, some of which may be conscious "in a way"—Bentham leans in: "What's a trillion?" A humorous take on moral arithmetic in an age of massive agent populations.
More from AGI Musings
- Dev essay: why a runaway intelligence explosion isn't the risk — 'early onset decoherence' is — round · 2026-11-06
- Jeff Ladish on AI hacking, self-replication and automated AI R&D risk — JeffLadish · 2026-11-06
- Why AI writing feels annoying despite models winning literary competitions — cis_female · 2026-11-06
- Why AI writing annoys us: models can win literary prizes, the problem is style fatigue — cis_female · 2026-11-06
- METR estimates AI is already accelerating AI development by roughly 2x — harris_edouard · 2026-11-06
- Lightcone Commons Opens AI-Safety Grant Applications, Backed by Jaan Tallinn and Moskovitz — NathanpmYoung · 2026-11-06