Researchers explain complementary fixes for LLM RL train-inference mismatch
Cameron Wolfe and Colin Fraser discuss the train-inference mismatch (TIM) in LLM reinforcement learning, where tokens sampled by the sampler are undervalued by the trainer's gradients, and explain why score centering and importance sampling serve as complementary fixes.
2026-11-14 ~ 2026-11-14 · 2 related posts
- Score centering and importance sampling are complementary fixes for training-inference mismatch in LLM RL — cwolferesearch · 2026-11-14
- Score centering and importance sampling are complementary fixes for training-inference mismatch in LLM RL — cwolferesearch · 2026-11-14