Paper: expert disagreement labels make LLMs flip answers more but not more accurately
Yupeng Tang · hf · 2026-11-18
A controlled two-pass audit varying only the revision context shows that LLMs often fail to selectively correct errors under disagreement. Adding an "expert" label increases reversals but does not reliably improve accuracy. The authors argue revision quality should be assessed with paired conditional metrics per model and protocol rather than aggregate accuracy.
More from Research
- Google/Penn State paper: Self-Improvement Memory lifts harness optimization gains by 2.36 points across models — rohanpaul_ai · 2026-11-18
- Google paper: Self-Improvement Memory lifts cross-model harness transfer from 68.41 to 84.75 — rohanpaul_ai · 2026-11-18
- Deep Bundle Adjustment: 590x smaller than VGGT, initialization-free 3D reconstruction beats COLMAP beyond 15 views — Singularitarian · 2026-11-18
- Argon open-sources Alloy, a multi-material physics engine for robot learning on one GPU — ycombinator · 2026-11-18
- Mohit Bansal's distinguished lectures at Columbia and Northwestern on trustworthy agents — mohitban47 · 2026-11-18
- Arc Institute's antiGen and Germinal Multi forecast virus mutations for proactive vaccine design — BrianHie · 2026-11-18