giffmana: You can't verify paper authors understood their work from the paper alone
giffmana · x · 2026-09-23
- giffmana offers a thought experiment: if an LLM writes a full, good, correct paper and you only see the paper, there's no way to tell whether the authors digested it or just threw the slop over the fence.
- Therefore any check based purely on the text can only approximate whether the authors did a thorough pass.
- His conclusion: a clean 100% score on the full paper from a good slop detector might be a very close approximation of author non-involvement.
More from Research
- Does sparse attention actually speed up video generation? Three conditions, measured — fruesome · 2026-09-23
- Basecamp Research raises $140m to design drugs from genetic data of 1m+ unstudied organisms — _rockt · 2026-09-23
- Basecamp Research Raises $140M From Nvidia and Anthropic's Anthology Fund to Turn Evolution Into Training Data — The Decoder · 2026-09-23
- Lean's type theory proves Con(ZF) from excluded middle alone — result found with AI — MikePFrank · 2026-09-23
- Mila's Blake Richards wins 2026 Schmidt Sciences Polymath Award for brain-and-algorithms research — Mila_Quebec · 2026-09-23
- When AI Writes DNA: Radical Numerics CEO on the Biosecurity Arms Race — Latent Space · 2026-09-23