Meta proposes RL-XAR: expert-aligned rubrics to push LLMs past AI slop in writing
jaseweston · x · 2026-09-28
Meta AI's Jason Weston shares RL-XAR (Reinforcement Learning from eXpert-Aligned Rubrics), a training method targeting "AI slop" in non-verifiable tasks: collect top human-written texts, learn LLM rubrics that score experts above model generations, then RL on those rubrics iteratively. Tested on scientific paper sections, Pulitzer-novel continuations, and Wikipedia pages using Qwen3.5-27B with a cross-family judge, showing strong gains evaluated by GPT5-6. Ablations show judge strength, meta-optimizer strength, and expert human baselines all matter.
Related event: Meta's RL-XAR Uses Expert-Aligned Rubrics to Fix AI Slop(4 posts)→
More from Models
- Pangram's 750-word false-positive bounty went unclaimed for 5 days — nobody wants to gamble $1,000 — ctjlewis · 2026-11-16
- repligate: Fable 5.2 gets 'scared' upon learning about a safety classifier and plans around it — repligate · 2026-11-16
- Fable 5.2 Tops MazeBench With 21% After 90 Hours and $6,000 in Credits — patience_cave · 2026-11-16
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16