"Overtrusting AI is a user problem" breaks down at the enterprise level, argues Redditor

Dapper-Tale-4021 · reddit · 2026-11-20

Following up on a debate from two weeks ago where the top comment claimed overtrusting AI is a user problem, not an AI problem, the author argues that framing is "half right" — and that's what bothers him.

At the individual level, he concedes the point: people have always taken bad advice from confident sources, and "user error" explains individual incidents like hikers trusting AI.

But it fails at the company level: when an organization puts a model into a workflow, hundreds of people inherit a decision they never made — without knowing what was tested, what the known failure modes were, or who signed off. Output disclaimers clearly don't work; people stop reading them within a week.

He asks the community for real organizational practices beyond the forgettable training slide.

Original post →

More from AGI Musings

AGI Musings channel →