NeurIPS 2026 paper 'Follow the Winners': imitate winning trajectories instead of PPO/GRPO

lawrennd · x · 2026-10-07

'Follow the Winners' by Zhenwen Dai et al. was accepted at NeurIPS 2026. It offers a simple alternative to PPO and GRPO for RL post-training: draw trajectories from a replay buffer, keep the winners, and imitate them — no critic, no group rollouts. Co-authors include Joery de Vries and Neil Lawrence.

Original post →

More from Research

Research channel →