AI Advice Cuts Human Accuracy by 3x While Doubling Confidence
ValerioCapraro · x · 2026-08-31
A new paper reveals the negative impact of AI advice on human judgment:
- Judgment suspension (“I don’t know” answers): Collapsed from 44% to 3%.
- Accuracy: Fell by a factor of three, from 27% to 9%.
- Confidence: Skyrocketed from 30/100 to 76/100.
Even with monetary incentives for accuracy, people become slightly more cautious and likely to override bad AI advice, but judgment suspension and accuracy remain dramatically below baseline.
Related event: Study: AI Advice Cuts Accuracy Threefold While Doubling Confidence(2 posts)→
More from Research
- Interpretability debate: one interpretable polysemantic neuron doesn't prove all are — aran_nayebi · 2026-10-16
- Optuna creator Akiba: when 2 hyperparameters cost $20M, what's left for BO/HPO — Stefania_druga · 2026-10-16
- AI will be superhuman at science regardless, and Europe can't opt out — teortaxesTex · 2026-10-16
- SERO augments long-horizon agentic RL with executable oracle continuations — Shanghai-AI-Laboratory · 2026-10-16
- Tsinghua and Amap propose OmniVerifier-C1, a graded verifier beating binary judges — Bowei Liu · 2026-10-16
- Alibaba open-sources MAI-Gym, an all-in-one GUI agent eval and RL training platform — Tongyi-MAI · 2026-10-16