Projection sampling: SFT learns like RL without catastrophic forgetting

A NeurIPS paper introduces projection sampling, an MCMC-based data transformation that lets SFT acquire new capabilities with less forgetting, matching or beating RL-based post-training in generalization.

2026-10-02 ~ 2026-10-03 · 4 related posts