RVM: Likelihood-Free Reward-Based Velocity Matching for Scaling Diffusion RL

gowthami_s · x · 2026-10-14

A new paper introduces RVM (reward-based velocity matching), an RL technique for diffusion models that weights the velocity-matching loss by reward with an anchor regression term — no likelihood ratios needed. Tested on SD3.5, Wan and SkyReels, RVM matches or outperforms prior methods, recovers Reinforce Adjoint Matching at the update level, and contains DiffusionNFT as a special case, unifying velocity-based reward fine-tuning.

Related event: RVM: Reward-Based Velocity Matching for Diffusion RL Fine-Tuning(2 posts)→

Original post →

More from Multimodal

Multimodal channel →