Google Brain researcher warns LLM literature audits lack judgment, risk witch hunts
rbhar90 · x · 2026-11-19
A well-known AI researcher (rbhar90) argues that proposals to use AI to audit the scientific literature are a terrible idea. His reasoning:
- LLMs lack judgment; there is enormous subtlety in distinguishing good science from genuine errors
- Drive-by LLM reviews could easily fuel witch hunts
- He's not against fixing errors, just believes today's LLMs aren't smart enough for the task
He predicts the real outcome will be massive make-work: researchers forced to justify their work against shoddy automated reviews.
More from AGI Musings
- Elicit on agent swarms: pharma winners of 2036 will robustly deploy them without going rogue — jungofthewon · 2026-11-19
- Pro vs. con arguments on AI "handover" rest on different moral foundations — 1a3orn · 2026-11-19
- Yoav Goldberg: server-side session APIs will make LLMs opaque — as bad as closed weights — yoavgo · 2026-11-19
- Follow-up: a transformer has no memory, self, or cognition, dev argues — gerardsans · 2026-11-19
- The site-builder era is repeating: people will hire humans to use AI app builders, says dev — sull · 2026-11-19
- Blogger goes contrarian: AI isn't currently moving toward higher general intelligence — LucaAmb · 2026-11-19