Paper-shaped no longer means trustworthy: scholars on how LLMs break academia's verification heuristic

gleech · x · 2026-11-14

Scholars argue that academia's implicit verification heuristic — a competent-looking paper was probably worth engaging with — collapses in the LLM era. As Jon Mellon notes, past papers were never fully reliable (p-hacking, poor measurement, overly cute identification strategies), but readers could at least predict the typical way they'd be wrong. LLM-generated "paper-shaped" artifacts remove even that baseline expectation.

Related event: LLMs shatter the illusion that paper-looking means trustworthy(2 posts)→

Original post →

More from AGI Musings

AGI Musings channel →