TRL's AsyncGRPOTrainer Cuts Wall-Clock Time by 3.8x with Same Reward Curve

QGallouedec · x · 2026-08-13

Hugging Face's TRL library introduced AsyncGRPOTrainer, leveraging asynchronous reinforcement learning (RL) to significantly boost LLM training efficiency.

The trainer decouples generation from training: a background worker streams completions from a vLLM server while the training loop consumes them. Benchmarked on sail/Sanity-Test-R1D-1.5B, the method achieves the same reward curve while running 3.8× faster in wall-clock time and consuming 1.9× fewer GPU-hours.

Related event: Hugging Face TRL Introduces AsyncGRPOTrainer for 2-4x Faster RL(3 posts)→

Original post →

More from Research

Research channel →