Regularized Score Centering fixes advantage estimation in agentic RL, 9.9× on BabyAI

aviral_kumar2 · x · 2026-11-20

jackbotcs introduces Regularized Score Centering (RSC): classic Score Centering subtracts the sampler's mean score per token but fails when the learner is far from the sampler; RSC adds a reverse KL to the sampler as a regularizer. RSC achieves the best results on all six agentic tasks, including a 9.9× improvement on BabyAI. Details in a 13-post thread.

Related event: Regularized Score Centering Boosts Agentic RL Performance(2 posts)→

Original post →

More from Research

Research channel →