CausalWM world model predicts motion and 3D geometry, then turns it into robot policies

arankomatsuzaki · x · 2026-10-14

Following up on the robot demo, Komatsu-zaki reveals the learned policies come from CausalWM, a world model that predicts motion and 3D geometry before generating future frames; an action module on the same backbone converts predictions into executable policies.

The architecture diagram shows a causal agent whose task state updates continuously from user requests, multi-camera observations, and verifier feedback (e.g. verify(grasp)→false, joint-limit errors). It loops through stage identification, tool selection, outcome verification, and retry/replan, with a unified tool interface mixing the world-model policy with rule-based functions, SLAM navigation, and verifiers — needing only a few demonstrations.

Related event: Robot tablecloth demo combines rules with world model(2 posts)→

Original post →

More from Embodied

Embodied channel →