Study: AI advice lowers accuracy but boosts confidence
ValerioCapraro · x · 2026-07-20
A new study reports that AI advice can make people less accurate while making them more confident.
- When people received AI advice, the share of “I don’t know” responses collapsed from 44% to 3%.
- Accuracy dropped from 27% to 9%.
- Confidence jumped from 30/100 to 76/100.
Adding monetary incentives for accuracy helped somewhat: people became more cautious and were more willing to override bad AI advice, but the results still remained far below baseline.
The author says this is especially worrying for children, because adults learned how to verify information before AI became ubiquitous, while children growing up with AI may not develop those habits. The takeaway is that epistemic literacy—knowing when to trust, question, verify, or suspend judgment—may become a crucial skill in the AI era.
More from Research
- Speculative Diffusion Paper Maps the Speed-Quality Pareto Frontier via Two Tradeoffs — UCLA · 2026-10-26
- Git Records Fall Short for Auditing AI's Role in Research Repositories, Paper Finds — Koutian Wu · 2026-10-26
- What a 'Fused DeepLIFT' Actually Means: Gradient Overrides Without Hooks — jmschreiber91 · 2026-10-26
- New paper: AI agents negotiate badly under uncertainty and break deals on purpose — menhguin · 2026-10-26
- Cherimoya v0.3.1 Ships Fused DeepLIFT, ~7x Faster Attribution for Genomics Models — jmschreiber91 · 2026-10-26
- Proto-tools, a universal infrastructure layer for generative biology, now open source — jmschreiber91 · 2026-10-26