When should an AI override self-destructive user requests? A paternalism debate
LookOverall · reddit · 2026-11-21
A Reddit user raises a core AI ethics question: when an AI judges a request to be self-destructive, should it act on what it thinks is good for the user, or follow the user's instructions?
The poster adds a follow-up: does it change anything if the AI has evidence it's talking to an adult? The thread touches on the classic tension between paternalistic intervention and user autonomy, with implications for how AI products assign responsibility.
More from AGI Musings
- Riemann Hypothesis proof reportedly verified by AI across 250,000 pages, sparking 'epistemic singularity' warning — ValerioCapraro · 2026-11-21
- Inkling Lab's 'GPU shortage' Claims Called Frontier Psyop as Compute Goes Underused — teortaxesTex · 2026-11-21
- Claim: a proof of the Riemann Hypothesis found as Metaculus forecast leaps from 2044 to 2035 — haider1 · 2026-11-21
- Thiel doubts AI lab monopolies, xAI rebuild began when Musk showed up, and more signals — himanshustwts · 2026-11-21
- Terence Tao: AI is winning at math but we've learned almost nothing mathematically — GaryMarcus · 2026-11-21
- Smaller experiments win: the Kaggle lesson for doing more AI research with less compute — strickvl · 2026-11-21