Anil Seth: Falsely attributing pain to LLMs carries its own catastrophic costs
anilkseth · x · 2026-09-21
Consciousness researcher Anil Seth pushes back against computational functionalist claims that LLMs might experience pain. He argues that any ethical exploration of LLM pain must be balanced against the ethical costs of false attribution of consciousness: (i) mental distress to users who worry about harming LLMs, and (ii) unnecessary, potentially catastrophic constraints on regulation and control intended to avoid causing LLM pain. If avoiding LLM pain conflicted with human interests, taking it seriously would be misaligned with us. Citing arguments against computational functionalism (his own and others' work), he concludes LLM consciousness—and thus LLM pain—is off the table, while endorsing Mustafa Suleyman's Humanist AI agenda with nuance: AIs being conscious is vanishingly unlikely, though not impossible.
Related event: Anil Seth Rebuts LLM Suffering Claims, Cites Costs of Misattribution(3 posts)→
More from AGI Musings
- Founder feedback now goes to Claude and GPT, fueling the solo founder boom — brezina · 2026-09-21
- The 'moral singularity' argument: unknowable ASI values rule out 50-50 optimism — danfaggella · 2026-09-21
- ToKTeacher: AI Speeds Error Correction, So We Must Solve Problems Much Faster — burny_tech · 2026-09-21
- Nate So8res breaks 'How would AI kill us?' into three distinct questions — ESYudkowsky · 2026-09-21
- Gary Marcus clashes with Gavin Baker: OpenAI won't be a monopoly because everyone shares the same recipe — GaryMarcus · 2026-09-21
- Jeff Bezos: AI Won't Kill Jobs, It Will Cause a Labor Shortage — rohanpaul_ai · 2026-09-21