Meta claims it can fix AI slop with RL-XAR: RL on expert-aligned rubrics for writing
jaseweston · x · 2026-09-28
- Jason Weston (Meta AI) announces RL-XAR (RL with eXpert-Aligned Rubrics), a training method targeting "AI slop" in non-verifiable tasks like writing.
- Pipeline: collect top human-written texts, learn LLM-judge rubrics that score experts above model generations, then run RL against those rubrics, iterating until meta-optimization finds no discernible gap.
- Motivation: pretraining reproduces context quality, and RLHF rewards inherit non-expert annotators' ceiling, so expert-level writing needs a new reward signal.
- Tested on scientific paper sections, Pulitzer-novel continuations and high-quality Wikipedia pages; multiple metrics show large gains (details in the thread's follow-up).
Related event: Meta's RL-XAR Uses Expert-Aligned Rubrics to Fix AI Slop(4 posts)→
More from Research
- Google Research open-sources PaperOrchestra, a multi-agent framework for writing AI papers — google-research · 2026-11-16
- Kind ICLR Reviewer Raises Score Despite Unresolved Concerns, Citing the Paper's Value — MarkSchmidtUBC · 2026-11-16
- Hand-editing 0.2% of weights plus 100 CPU-minutes turns an English TTS model into an 18MB Sanskrit one — kastnerkyle · 2026-11-16
- Why chirality matters for AI for Science: enantiomers behave differently in biology — madeofAjala · 2026-11-16
- RSS 2027 submissions open with FAQ clarifying two-stage review and negative-result bar — GeorgiaChal · 2026-11-16
- Mobile AI Factory: agents auto-build on-device SLMs with 19x less GPU time — pmttyji · 2026-11-16