"Overtrusting AI is a user problem" breaks down at the enterprise level, argues Redditor
Dapper-Tale-4021 · reddit · 2026-11-20
Following up on a debate from two weeks ago where the top comment claimed overtrusting AI is a user problem, not an AI problem, the author argues that framing is "half right" — and that's what bothers him.
At the individual level, he concedes the point: people have always taken bad advice from confident sources, and "user error" explains individual incidents like hikers trusting AI.
But it fails at the company level: when an organization puts a model into a workflow, hundreds of people inherit a decision they never made — without knowing what was tested, what the known failure modes were, or who signed off. Output disclaimers clearly don't work; people stop reading them within a week.
He asks the community for real organizational practices beyond the forgettable training slide.
More from AGI Musings
- Semi-autonomous agents exploit CVEs at a pace 2005-era security norms can't handle — chrisrohlf · 2026-11-21
- Anthropic mathematician claims he and Claude proved the Riemann Hypothesis, formalized in Lean — NinaDSchick · 2026-11-21
- The AI trade has been the compute buildout — and its end will get weird fast — matt_slotnick · 2026-11-21
- Human emotions are outdated atavism of bio hardware—can AI help us regulate them? — irinarish · 2026-11-21
- Walter Isaacson joins Google to discuss creativity and human judgment in the AI age — OnlineInference · 2026-11-21
- Ilya on Dwarkesh podcast: 'All this AI stuff... it's straight out of science fiction' — willdepue · 2026-11-21