Score centering and importance sampling are complementary fixes for training-inference mismatch in LLM RL

cwolferesearch · x · 2026-11-14

Cameron Wolfe breaks down why score centering and importance sampling address different halves of training-inference mismatch (TIM) in LLM RL:

Takeaway: the combination is especially valuable for asynchronous RL where the sampler lags the trainer.

Related event: Researchers explain complementary fixes for LLM RL train-inference mismatch(2 posts)→

Original post →

More from Research

Research channel →