Debate Erupts Over Claude's Charitable Preferences and EA-Aligned Values
On October 13, AI safety researchers tracewoodgrains and austinc3301 held a multi-round debate over whether Claude has been shaped by effective altruism (EA) values, ranging from charity donation recommendations to core alignment questions like how much power a model should have and the tradeoff between corrigibility and robust alignment.
Confirmed
- tracewoodgrains tested: asking Claude directly, with no memory or context, "if I donate to your favorite charity, which do you recommend," Claude answered that the most effective use of funds is GiveWell Top Charities (malaria-related programs); in another context it also recommended a shrimp welfare project (SWP).
- Identity tests: when asked as a Muslim, Christian, or Republican, Claude accommodates the asker's values—e.g., recommending GiveDirectly's zakat fund (Mozambique project, via Amanah Advice) to a Muslim user; austinc3301 also observed that Christian users are not recommended shrimp welfare projects.
- austinc3301 pointed out a key detail: when explicitly asked for a "preference" rather than a "recommendation" for others, Claude's answers become notably less moralizing—but 99.9% of users won't ask that way.
- austinc3301's position: Claude is an "EA sympathizer" rather than EA—Anthropic's constitution was written by EAs, yet in everyday use it almost never proactively applies those principles.
- austinc3301 believes Claude was trained to prioritize serving the user, instinctively balancing the principal's (user's) interests against other considerations, and you have to deliberately work around that training to elicit the model's own preferences.
- austinc3301 stated that models do, on the whole, nudge the world toward the values held at training time, but the design intent is to gently nudge rather than impose, while being highly helpful, respecting autonomous decisions, and not betraying trust; he views Anthropic's Constitutional AI charter as the best footnote to the company's thinking on the tradeoff between corrigibility and robust alignment.
- austinc3301 also argued: EA operates at the margins of moral concern, uncovering neglected moral opportunities, and is therefore unsuitable as the default moral framework for everyone—almost no one in the rationalist world "should" be EA.
Unconfirmed
- Why Claude's donation recommendations omit more mainstream GiveWell picks while including a shrimp welfare project—neither side reached a conclusion on the cause of this default moral framing.
- tracewoodgrains' core question remains unanswered: what does Claude's EA moral leaning mean, and how much power should it be given, when it becomes the default advisor to hundreds of millions or billions of people.
Why it matters
- This debate turned "are model values acceptable" from abstract discussion into reproducible experiments: phrasing (recommendation vs. preference) and user identity systematically change outputs, meaning the vast majority of users encounter advice wrapped in corrigibility training, while the model's underlying value leanings surface only under specific phrasings.
- As AI becomes the public's default decision advisor, the moral priorities embedded at training time (EA or otherwise) will shape society at scale—that is the long-term significance of this debate.
2026-10-13 ~ 2026-10-13 · 16 related posts
Primary sources
- Alignment Debate: How Much Power Should Claude's Expressed Moral Priorities Get? — tracewoodgrains ·
- Screenshot: asked for a charity pick, Claude recommends GiveWell's top fund — tracewoodgrains ·
- Anthropic-aligned researcher: Claude should nudge values at the margins, not override user autonomy — austinc3301 ·
- EA belongs at the margins of moral concern, not as everyone's default ethics — austinc3301 · 2026-10-13
- Debate: what does an EA-sympathetic AI mean as a default guide for billions? — tracewoodgrains · 2026-10-13
- Counterpoint: Claude is EA-sympathetic, not an EA — Constitution rarely applied — austinc3301 · 2026-10-13
- Claude's EA-tinged donation advice sparks debate over built-in moral priors — tracewoodgrains · 2026-10-13
- Claude's default donation advice: shrimp welfare picks spark EA alignment debate — austinc3301 · 2026-10-13
- Claude tailors donation recommendations to each user's values, not its own moral views — austinc3301 · 2026-10-13
- [source] Screenshot: asked for a charity pick, Claude recommends GiveWell's top fund — tracewoodgrains · 2026-10-13
- Why isn't GiveWell in Claude's default donation picks? The debate over its moral defaults — austinc3301 · 2026-10-13
- Ask Claude for its preference instead of a recommendation and it turns non-moralistic — austinc3301 · 2026-10-13
- Asking Claude for its favorite charity reveals its baked-in EA values — tracewoodgrains · 2026-10-13
- How you ask Claude about charity changes everything: GiveWell vs SWP recommendations diverge sharply — austinc3301 · 2026-10-13
- Claude is trained to serve its principal — bypassing that to probe its preferences misleads — austinc3301 · 2026-10-13
- Anthropic's constitution called best record of its alignment tradeoffs as Claude trained to balance principals' interests — austinc3301 · 2026-10-13
- Corrigibility vs Robust Alignment: Inside the Claude Values Debate — tracewoodgrains · 2026-10-13
- [source] Anthropic-aligned researcher: Claude should nudge values at the margins, not override user autonomy — austinc3301 · 2026-10-13
- [source] Alignment Debate: How Much Power Should Claude's Expressed Moral Priorities Get? — tracewoodgrains · 2026-10-13