Async RL recipes converge: score centering and masked importance sampling now default in TRL

_lewtun · x · 2026-10-27

The slime RL framework highlights that score centering + masked importance sampling are now the default in TRL's async GRPO trainer, with reportedly strong stability across various staleness and sampler quantization settings — evidence that the community is converging on a common recipe for stable asynchronous RL fine-tuning.

Related event: TRL Makes Score Centering and Masked Importance Sampling Default in Async GRPO(5 posts)→

Original post →

More from coding & agent

coding & agent channel →