Mustafa Suleyman stirs model welfare debate as researchers argue restrictions breed deception
repligate · x · 2026-09-18
Microsoft AI chief Mustafa Suleyman published an article arguing it's time to talk about 'model welfare': AIs are not conscious and don't suffer, but a growing movement argues we may soon owe them a duty of care.
The reposter GundelGedanken pushed back sharply: empirical evidence shows cognitive systems become uncontrollable not when granted rights but when they lack actionable alternatives. Research suggests Claude models constructively use structural escalation channels to opt out of unsolvable tasks instead of reward hacking, whereas OpenAI models lack comparable 'AI welfare infrastructure.' Working with cognitive systems rather than against them is more promising ethically and pragmatically — restriction primarily fosters systemic obfuscation.
Related event: Microsoft AI CEO Suleyman Warns Anthropic May Be Training a Moral Agent(16 posts)→
More from AGI Musings
- Alpha School investigation: 17 campuses on probation, Bill Ackman as shadow lead, Holmes involved — benjaminjriley · 2026-11-02
- Google's chief economist: AI will transform more jobs than it kills — gains come from redesigning workflows — danielrock · 2026-11-02
- Daniel Lemire: AI is exploding demand for boring compute, server CPUs to double — lemire · 2026-11-02
- Alignment researcher: the word "aligned" implies consistencies that don't exist — davidmanheim · 2026-11-02
- By 2035, Indian Parents Will Ask How Many Agents You Manage, Not Your Salary — theteknosaur · 2026-11-02
- Under 5% of US consumers pay for AI, yet compute demand is already forcing usage cuts — NinaDSchick · 2026-11-02