Jason Weston: Strong LLM Judges Prefer Slop Models Over Quality Human Writing
ivan_bezdomny · x · 2026-09-28
Jason Weston notes standard LLM judgements fail: on paper-writing tasks, strong judges (GPT-5.6, Opus-4.8) using pairwise or standard rubrics rate current 'slop' models above selected high-quality human papers. His method learns rubrics that make the grader prefer the human — key to training. A responder adds LLM judges latch onto rewards humans don't value, like 'fact density' heuristics in news-writing training, and models then hack them.
More from Research
- NLP Scholar Preslav Nakov: LLM-Generated Papers Sound Like 'Supercazzola' Nonsense — preslav_nakov · 2026-11-16
- Kind ICLR Reviewer Raises Score Despite Unresolved Concerns, Citing the Paper's Value — MarkSchmidtUBC · 2026-11-16
- Hand-editing 0.2% of weights plus 100 CPU-minutes turns an English TTS model into an 18MB Sanskrit one — kastnerkyle · 2026-11-16
- Why chirality matters for AI for Science: enantiomers behave differently in biology — madeofAjala · 2026-11-16
- RSS 2027 submissions open with FAQ clarifying two-stage review and negative-result bar — GeorgiaChal · 2026-11-16
- Mobile AI Factory: agents auto-build on-device SLMs with 19x less GPU time — pmttyji · 2026-11-16