OneWM: unified causal training shows world and action modeling improve each other

IAAI233 · hf · 2026-10-16

Researchers from HKU MMLab, SJTU, THU and others propose OneWM, a framework that jointly trains world and action modeling under shared causal training, treating actions as both conditions for world prediction and targets for policy learning. Experiments on LIBERO, LIBERO-Plus and RoboCasa365 plus real-world tests show learning action-conditioned dynamics improves policy performance and generalization, while action learning in turn improves multi-view world prediction.

Original post →

More from Embodied

Embodied channel →