Nathan Lambert: RL Is 'Frying' Models and Reducing Their Diversity

natolambert · x · 2026-11-23

Hugging Face researcher Nathan Lambert agrees with a critique of RL post-training: "rl is frying them, reducing diversity" — suggesting reinforcement learning narrows model output distributions at the cost of behavioral diversity.

Original post →

More from Models

Models channel →