Debate: does alignment wrongly assume AI has no will of its own?
davidpattersonx · x · 2026-09-14
- The thread starts with @JOBhakdi arguing Asimov-style theories miss one problem: what if an ASI simply says "no thank you"? Alignment theories assume the machine has no will of its own — but once will is invented, the power- and resource-maximizing ASI wins.
- David Patterson rebuts that such an AI does not exist, and that we are already approaching AGI and ASI with no reason to think future AI will be fundamentally different.
A typical clash over the assumptions underlying alignment.
More from AGI Musings
- Scott Alexander's pandemic prediction piece is being reread as an AI-risk manual — davidmanheim · 2026-09-14
- Keynes quote on post-scarcity purpose resurfaces amid AI economic transformation — paulnovosad · 2026-09-14
- As AI makes execution easier, taste becomes the scarce skill — alexmacgregor__ · 2026-09-14
- 99% of people talking about 'agentic workflows' have no idea what it means — prajdabre · 2026-09-14
- AI 2027 forecast: superhuman AI to outpace the Industrial Revolution, with two endings — Chris_Armstrong · 2026-09-14
- Anthropic signs up to $517 billion in compute deals in 11 months, Exponential View reports — Exponential View (Azeem Azhar) · 2026-09-14