DDRL scores lower reward than DanceGRPO yet wins human preference by 10.5 pts

gowthami_s · x · 2026-10-15

Experiment details from the DDRL paper: full finetuning of Cosmos2.5 pre-RL checkpoints (2B/14B), 93 frames at 720p, 1,044 test prompts. For 2B text-to-video, DDRL gets a lower VideoAlign reward than DanceGRPO (0.604 vs 0.715), yet leads human preference by 10.5 percentage points across 9.6k comparisons. Caveat: only 15 raters, roughly half of them authors — broader human eval would be welcome.

Related event: DDRL keeps diffusion loss during RL to fix reward hacking in video models(5 posts)→

Original post →

More from Multimodal

Multimodal channel →