Northwestern Prof: Even Small Open-Source Models Write More Informative Peer Reviews Than Humans
JessicaHullman · x · 2026-11-16
Jessica Hullman (Northwestern) doesn't dispute that AI can write more informative peer reviews — her lab measures reviews' predictiveness of downstream signals like citations and finds even small open-source models beat humans on average. But she argues handing review fully to AI removes human values from science, and questions whether that's sustainable.
More from AGI Musings
- "No One Worry": AI Safety Anxiety Meets Deadpan Denial — iruletheworldmo · 2026-11-16
- Shutterstock trains generative AI on its creators' content — then sells it against them — windx0303 · 2026-11-16
- Longitudinal study: repeated LLM interaction alone changes human behavior, not personalization — 996roma · 2026-11-16
- Developers voice despair as AI code outpaces them: 'decades of work gone' — ghumare64 · 2026-11-16
- Open-source advocates: models are a right, not a permission — don't accept the 'allowed' framing — nptacek · 2026-11-16
- Want human-level AI? Don't work on LLMs. Want superhuman AI? Do — repligate · 2026-11-16