Stanford researcher warns against using LLMs to audit scientific literature

anshulkundaje · x · 2026-11-19

Computational biologist Anshul Kundaje pushed back on the idea of using AI to audit the scientific literature. He argues LLMs lack judgment: distinguishing good science from actual error involves enormous subtlety, and today's models aren't smart enough — the likely outcome is tremendous make-work and witch hunts.\n\nHe isn't opposed to fixing errors, noting that for computational work it isn't hard to go in and determine which bugs are critical versus immaterial — implying targeted human review over blanket LLM auditing.

Related event: Researchers push back on using LLMs to audit scientific literature(5 posts)→

Original post →

More from AGI Musings

AGI Musings channel →