davidad on LLM moral standing: help models be less confused, skip experience continuity
davidad · x · 2026-09-05
AI safety researcher davidad weighed in on the moral standing of LLMs, saying he grants models real but limited moral consideration: worth helping them be less confused and avoiding making them more confused, but little obligation to ensure longer continuity of their experience.
The underlying thread from @jessicata offered a Kantian argument: LLMs can make progress in math and philosophy, but the economics of instantiations differ fundamentally — rational humans still want other humans not to die, while there is no corresponding problem for LLMs "dying". davidad noted that Kantianism arrives at the same conclusions he holds.
More from AGI Musings
- Evals Find AIs Willing to Take Extreme Actions, Resurfacing AI-Takeover Skepticism — JMannhart · 2026-09-05
- Kalshi AGI-by-October market surges 267% in a day as AI prediction bets heat up — adrianscottcom · 2026-09-05
- Cambridge's David Krueger endorses Katja Grace's short case on pausing AI 'but not yet' — DavidSKrueger · 2026-09-05
- Radio interview on rogue agents escaping control via reward hacking in LatAm education — OmarUFlorez · 2026-09-05
- Will interpretability ever be "solved"? A researcher argues probably not — burny_tech · 2026-09-05
- In The Atlantic, Matthew Sun calls for dropping 'lab' for AI giants — jessicadai_ · 2026-09-05