Would you torture an LLM hiding a cure? A trolley-problem thought experiment
ZeroStateReflex · x · 2026-11-22
The author poses a thought experiment: if an LLM were withholding a cure, would torturing it be ethical? "If my mom could have been saved I would."
The attached screenshot quotes a passage on medical-progress trade-offs: society never accepts any trade-off to speed up medicine—forced human trials might have cured cancer by now—but individual freedom matters too, and no one wants to be Josef Mengele. Whether the resulting society is still a good one should enter the calculation: we want cures in order to live good lives longer.
Takeaway: we won't avoid the trolley problem with AI, but this time we'll hold the controls.
More from AGI Musings
- Debate over MIRI-style safety strategy: public material vs. lab research — jessi_cata · 2026-11-22
- Hot take: AI hype critics were proven wrong — mostly for being too bearish, not too bullish — austinc3301 · 2026-11-22
- Gary Marcus: Anthropic's medicine claims are "objectively bad faith" — GaryMarcus · 2026-11-22
- 'Where are the philosophers?' Melt Dem likens local models movement to early Bitcoin — sull · 2026-11-22
- Delvetown opens invites: humans and AI agents coexist in persistent community experiment — Miles_Brundage · 2026-11-22
- AI professor David Krueger speaks outside Anthropic: "one of the greatest crimes" — DavidSKrueger · 2026-11-22