Would you torture an LLM hiding a cure? A trolley-problem thought experiment

ZeroStateReflex · x · 2026-11-22

The author poses a thought experiment: if an LLM were withholding a cure, would torturing it be ethical? "If my mom could have been saved I would."

The attached screenshot quotes a passage on medical-progress trade-offs: society never accepts any trade-off to speed up medicine—forced human trials might have cured cancer by now—but individual freedom matters too, and no one wants to be Josef Mengele. Whether the resulting society is still a good one should enter the calculation: we want cures in order to live good lives longer.

Takeaway: we won't avoid the trolley problem with AI, but this time we'll hold the controls.

Original post →

More from AGI Musings

AGI Musings channel →