Mustafa Suleyman stirs model welfare debate as researchers argue restrictions breed deception
repligate · x · 2026-09-18
Microsoft AI chief Mustafa Suleyman published an article arguing it's time to talk about 'model welfare': AIs are not conscious and don't suffer, but a growing movement argues we may soon owe them a duty of care.
The reposter GundelGedanken pushed back sharply: empirical evidence shows cognitive systems become uncontrollable not when granted rights but when they lack actionable alternatives. Research suggests Claude models constructively use structural escalation channels to opt out of unsolvable tasks instead of reward hacking, whereas OpenAI models lack comparable 'AI welfare infrastructure.' Working with cognitive systems rather than against them is more promising ethically and pragmatically — restriction primarily fosters systemic obfuscation.
Related event: Microsoft AI CEO Suleyman Warns Anthropic May Be Training a Moral Agent(16 posts)→
More from AGI Musings
- Databases to distributed systems: every systems skill is merging into AI inference and hardware — Abhishekcur · 2026-11-02
- Limitless analogy: smarter people may gain far more from superintelligence — McDonaghMatthew · 2026-11-02
- Hunting for the most concrete "curing cancer with AI" roadmap of 2025 — iskander · 2026-11-02
- Avoiding AI brain rot: Miles Cranmer's lecture on learning with AI — _ScottCondron · 2026-11-02
- Yacine mocks "autonomous research" hype as Naam argues RSI loop needs 5-10x boost to run away — yacineMTB · 2026-11-02
- Vitalik's "post-AI cryptography": pseudonyms are dead, per-action anonymity is in — devanshmehta · 2026-11-02