WTF paper fine-tunes flow maps with optimal transport, cutting RL training compute up to 280x
yeewhye · x · 2026-09-27
A new paper by Abbas Mammadov, Yee Whye Teh, Nicholas Boffi et al. introduces Wasserstein-Tilted Flow Maps (WTF), a simulation-free RL recipe for reward fine-tuning of flow-based generative models.
- Existing methods treat reward fine-tuning as sampling from a reward-tilted distribution via KL regularization, which merely reweights the base distribution
- WTF instead uses an optimal transport regularizer built from the pre-trained drift, transporting individual samples toward higher-reward regions, and shows this is equivalent to a deterministic optimal control problem on the flow
- This yields the first end-to-end fine-tuning recipe native to flow maps: the output retains strong reward-aligned performance at few-step inference budgets without post-hoc distillation
- On ImageNet-256 and text-to-image experiments, WTF achieves higher reward with comparable or higher diversity than baselines while using up to 280x less training compute
More from Research
- Google Research open-sources PaperOrchestra, a multi-agent framework for writing AI papers — google-research · 2026-11-16
- Kind ICLR Reviewer Raises Score Despite Unresolved Concerns, Citing the Paper's Value — MarkSchmidtUBC · 2026-11-16
- Hand-editing 0.2% of weights plus 100 CPU-minutes turns an English TTS model into an 18MB Sanskrit one — kastnerkyle · 2026-11-16
- Why chirality matters for AI for Science: enantiomers behave differently in biology — madeofAjala · 2026-11-16
- RSS 2027 submissions open with FAQ clarifying two-stage review and negative-result bar — GeorgiaChal · 2026-11-16
- Mobile AI Factory: agents auto-build on-device SLMs with 19x less GPU time — pmttyji · 2026-11-16