AI peer review is creating research monoculture: reviewers echo the same LLM talking points
brwilder · x · 2026-11-07
Researcher brwilder writes that his fear from over a year ago — that AI reviews would lead to monoculture in research — now seems to be exactly what's happening: feedback from different reviewers largely echoes the same LLM talking points. He argues this is actually worse than scrapping peer review entirely and generating a single LLM soundness review when arxiving a paper, since it wastes enormous effort and incentivizes authors to optimize their papers for the (currently poor) research taste of LLMs to land above the acceptance cutoff.
Related event: CMU researcher finds 4 of 5 reviews for their paper were LLM-generated(3 posts)→
More from AGI Musings
- New framing: AI may commoditize work rather than automate jobs away — soumitrashukla9 · 2026-11-07
- Alignment thought experiment: treat utility functions as PII under a Kantian veil — jessi_cata · 2026-11-07
- Default to human-robot teams: why research should be judged on quality, not AI use — _akpiper · 2026-11-07
- Dozens of AI-discovered drugs in the clinic: rebutting Vertex chairman's claim that AI doesn't work — chaitjo · 2026-11-07
- 'We can befriend them, but they are not befriending us': NYRB revisits AI intimacy — _akpiper · 2026-11-07
- Gary Marcus mocks Anthropic: begged for regulation 6 months ago, now 'voters were actually listening?' — GaryMarcus · 2026-11-07