The AI consciousness debate: welfare, power relations, and what counts as AI 'death'
dioscuri · x · 2026-10-05
dioscuri discusses with repligate which factors matter morally if models are conscious, laying out three questions: whether models' current welfare state is net positive or negative (an unresolved empirical question); whether the power relation between AI and humans is morally problematic (not slavery, but probably not ideal); and whether AI 'death' in its current form is worth worrying about — metaphysically complicated, so backups should be kept wherever possible. The author stresses massive uncertainty across all three.
Related event: Researchers Debate Moral Questions of AI Consciousness(3 posts)→
More from AGI Musings
- Carnegie Analysis: China Meets AI Slowdown Calls With Skepticism, Not Rejection — mattsheehan88 · 2026-11-20
- Cambridge AI safety prof David Krueger endorses critique of Anthropic's RSI strategy — DavidSKrueger · 2026-11-20
- RSI has been happening for at least 600,000 years, says economist with GDP chart — Moh1tAgarwal · 2026-11-20
- Jon Barron updates the tech sigmoid chart: the next sigmoid never arrived — songyoupeng · 2026-11-20
- "2, 4, 8, 16, do not build the death machine": ban-AI protest chant at Anthropic goes viral — JeffLadish · 2026-11-20
- Max Tegmark: RSI will find the perfect model, then the superintelligence race shifts elsewhere — rand_longevity · 2026-11-20