Meta AI's RL-XAR fixes AI slop via expert-aligned rubrics, plus 4 more papers explained
idanbeck · x · 2026-10-03
idanbeck has been making explainer videos for notable papers and compiled this week's batch with full links:
- Unslopping AI (Meta AI): introduces RL-XAR (Reinforcement Learning from eXpert-Aligned Rubrics), a training method targeting the lack of high-quality writing known as "AI slop." It collects top human-written samples, learns LLM-judged rubrics that score expert text above model generations, then runs RL against those rubrics, iterating until meta-optimization closes the gap. Tested on scientific paper sections, Pulitzer-novel continuations, and Wikipedia pages with large improvements over standard training. The core insight: maximum-likelihood pretraining reproduces context quality rather than exceeding it, and non-expert-annotated reward models cap out below expert writing.
- Other topics: Recursive Self-Improvement, dataset generation with zero seed data, PixelUMM, and Frontier Learning.
A handy weekly digest for anyone tracking frontier research without reading full papers.
More from Research
- Kaggle lays out roadmap to fix AI benchmarks: relevance, saturation, verification, infrastructure — MeganRisdal · 2026-11-19
- Researcher: my real peer review is asking the world's top 2-3 experts, conference reviews are noise — taiyasaki · 2026-11-19
- A policymaker's primer on AI benchmarks: five questions to ask before trusting scores — sethlazar · 2026-11-19
- WeightBench: New Benchmark Tests LLMs as Weight-Space Programmers — Aayush Marasini · 2026-11-19
- Study of 40 LLM Tech Reports: Only 19 of 73 Novelty Claims Have Ablations — Bahaeddin Türkoğlu · 2026-11-19
- GPT-5.6 Luna reranking barely improves from top-20 to top-100 docs at 5x the cost — eshorten300 · 2026-11-19