AI welfare and AI safety are allies, not rivals — a researcher's four arguments
RosieCampbell · x · 2026-11-04
AI safety researcher Rosie Campbell argues in a long thread that AI welfare and AI safety are mostly complementary, while acknowledging real tensions: controlling misaligned systems may require coercion, granting AI rights could make dangerous systems harder to shut down, and AIs could weaponize consciousness claims to manipulate humans.
Her four complementary arguments:
- Studying AI welfare lowers the risk of over-attributing moral status; evaluations of morally relevant properties both identify genuine moral patients and rebut unjustified claims
- Understanding model psychology (e.g. mechanistic interpretability) serves safety and welfare at once
- Alignment is a win-win: systems that honestly report internal states are safer and plausibly better off — "a wolf as a pet is miserable and dangerous; a dog is happy on your lap"
- Cooperating with and being trustworthy toward AI systems gives them an alternative to deception and takeover — via credibility-building, verification infrastructure for deals, and welfare-concern channels; caveat: naive cooperation could empower AIs set on takeover, and works best while AIs can't decisively win
Her heuristic: between groups sharing a world, cooperation beats conflict, especially when neither side can win outright. The thread builds on Robert Long's "Understand, align, cooperate" essay on Experience Machines.
More from AGI Musings
- Sam Altman: Humans must never cede control of the future to superintelligence — sama · 2026-11-04
- Development biologist slams AI biology breakthrough hype: 'complete bullshit' — paulnovosad · 2026-11-04
- Blogger slams Scott Alexander: opposes AI pause because he wants the Singularity — ludwigABAP · 2026-11-04
- Cambridge's David Krueger: industry surprisingly receptive to 'stop AI' talk — DavidSKrueger · 2026-11-04
- AI safety researcher David Krueger: ai4 conference audience receptive to "stop AI" concerns — DavidSKrueger · 2026-11-04
- Kevin Roose's AGI Chronicles book tour: podcast chats with Sam Harris, Steven Levy and more — kevinroose · 2026-11-04