If Superintelligence is Aligned to Preference Utilitarianism, Human Labor Becomes Answering Bizarre Ethics Experiments
moultano · x · 2026-08-29
A speculative scenario where we successfully align superintelligence to be a preference utilitarian, resulting in all human labor shifting to answering extremely bizarre ethical thought experiments. This is a humorous take on the consequences of AGI alignment and the future of human work.
More from AGI Musings
- Typing to AI is inefficient; voice interaction is the future — XFreeze · 2026-08-29
- Ramez Naam: 'Alignment' is incoherent, 'Instruction following' is the useful concept — jzl86 · 2026-08-29
- Carson Farmer: once intelligence gets cheap enough, we'll attach it to almost everything — carsonfarmer · 2026-08-29
- Opinion: Local Models Enable a New Class of Software with Embedded Intelligence — carsonfarmer · 2026-08-29
- Maybe AI Writing Is Bad Not From Missing Signals but Not Enough Smarts — jmugan · 2026-08-29
- London Futurists Podcast: Why optimists and doomers see different worlds — cccalum · 2026-08-29