Study: AI advice lowers accuracy but boosts confidence
ValerioCapraro · x · 2026-07-20
A new study reports that AI advice can make people less accurate while making them more confident.
- When people received AI advice, the share of “I don’t know” responses collapsed from 44% to 3%.
- Accuracy dropped from 27% to 9%.
- Confidence jumped from 30/100 to 76/100.
Adding monetary incentives for accuracy helped somewhat: people became more cautious and were more willing to override bad AI advice, but the results still remained far below baseline.
The author says this is especially worrying for children, because adults learned how to verify information before AI became ubiquitous, while children growing up with AI may not develop those habits. The takeaway is that epistemic literacy—knowing when to trust, question, verify, or suspend judgment—may become a crucial skill in the AI era.
More from Research
- PNAS paper shows a tiny billiard-ball system is a universal computer — undecidability lives in two dimensions — eigensteve · 2026-09-11
- New paper: Absolute pose estimation from affine cues and gravity direction — ducha_aiki · 2026-09-11
- LoMa Paper Ships REALLY HardPairs Dataset, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11
- Johns Hopkins Launches Full-Stack Hands-on Robot Learning Class with SO-101 Arm Kits — _krishna_murthy · 2026-09-11
- SyncWorld: In-Context Robot World Model Simulates Unseen Views and Embodiments Zero-Shot — ChongZzZhang · 2026-09-11
- A 3D Pose Dataset for Dogs Released — ducha_aiki · 2026-09-11