AAAI Alignment track reviews caught being LLM one-shotted; authors refuse to engage
sethlazar · x · 2026-11-03
Researcher Seth Lazar reports that 3 reviews for his AAAI Alignment track submission were clearly one-shotted with LLMs contrary to policy (and not part of the official experiment), prompted to act like the worst kind of reviewer 2 — no real human engagement, yet none of the judgment of a good reviewer. The team's rebuttal stated they won't engage with LLM-produced reviews. A third, clearly human review offered sensible critique, which they salute. Lazar warns that a very significant fraction of reviewers now use LLMs, destroying the intellectual infrastructure that makes academic work possible: if you don't have time, decline the review.
More from Safety
- US Army investigates suspected hacks behind freezer failures across Europe — J_MaestreVidal · 2026-11-03
- The AGI to fear isn't one that turns on humanity, but one imposing a few people's choices on everyone — SuB8u · 2026-11-03
- Man jailed 1 year for selling fake WeChat red-packet mini programs that harvested location data — JourneymanChina · 2026-11-03
- OpenAI updates Model Spec: intent over literal instruction-following — sven_ai · 2026-11-03
- OpenAI's Grid Protectors program lets utilities cut up to 1,000MW from its Georgia data center — rohanpaul_ai · 2026-11-03
- Wharton Study: Persuasion Principles Lift LLM Compliance from 33% to 72% — adrianscottcom · 2026-11-03