Yarin Gal: LLM experiments that don't replicate are just failures, and an AI arXiv could help
yaringal · x · 2026-09-23
In a follow-up to his call for arXiv to reject LLM-written papers, Oxford's Yarin Gal argues that non-replicating LLM-written experiments should be treated like any other failed experiment, and suggests an 'AI arXiv' for LLM-written papers. He maintains that filtering only LLM-written prose (not LLM-assisted experiments/proofs) would drastically cut slop by raising the cost of spamming.
Related event: Oxford's Yarin Gal: Irreproducible LLM Experiments Are Just Bad Experiments(2 posts)→
More from Research
- 50+ NeurIPS 2025 papers found containing AI hallucinations that slipped past peer review — CSProfKGD · 2026-11-12
- Indie researcher pauses RNN training over environment bugs, shifts to FunSearch-style tasks — cephaloform · 2026-11-12
- Self-supervised visual similarity partially explains word generalization in humans and machines — Patricio M. Vera · 2026-11-12
- P2Echo: one text-prompted model segments multi-view echocardiography with high accuracy and low cost — UBC-V · 2026-11-12
- I Fixed Alamo Drafthouse's Search With Query Logs Alone: +18.4% MRR, No Model Training — CShorten30 · 2026-11-12
- NYU lab open-sources Outerloop: autonomous research agents that open PRs only when benchmarks improve — mengyer · 2026-11-12