Tencent's Adaptive Reward Routing Dynamically Balances Multi-Reward RL for Joint Audio-Video Diffusion
tencent · hf · 2026-10-02
Tencent proposes Adaptive Reward Routing for forward-process RL (DiffusionNFT) of joint audio-video diffusion models, dynamically adapting where reward updates act and how competing rewards combine. Cross-Modal Influence-Guided Routing uses bidirectional cross-attention responses as a proxy to reweight token-level losses and scale gradients across cross-modal layers; Preference-Preserving Modality-Aware Reweighting keeps predefined weights as priors with residual corrections from branch-level reward-gradient interactions. Experiments show consistent gains in modality quality, semantic consistency, and audio-video synchronization over strong RL baselines.
Related event: Tencent Proposes Adaptive Reward Routing for Joint Audio-Video Diffusion RL(2 posts)→
More from Multimodal
- Fitting 5 character LoRAs in one image: 4 methods tested, best hits 3/5 — PoleRacers · 2026-11-19
- AI-generated robot priest praying in a candlelit church goes viral on Reddit — MrWoohoo · 2026-11-19
- AI-made retro anime short 'The Gatekeeper Episode 1' nails hand-drawn cel style — oultimobuilder · 2026-11-19
- AI-generated Arc'teryx spec ad wows viewers with near-perfect camera work and sound — gen_ericai · 2026-11-19
- AI Animated Short 'The Solar Ascendant' Shows Pixar-Grade Flaming Monkey Hero — Solaris-Frame · 2026-11-19
- AI video brings Mona Lisa, Van Gogh and Dalí together across centuries — sebpaquet · 2026-11-19