DreamCan: Li Fei-Fei team's sparse keyframe world model for long-horizon robot planning

chris_j_paxton · x · 2026-10-24

A Stanford team including Li Fei-Fei and Jiajun Wu introduces DreamCan, a sparse visual planner for long-horizon robot manipulation: instead of imagining every frame, it generates a sequence of sparse keyframe subgoals balancing reachability and task utility.

Method: learn a reachability value function from action-free videos via goal-conditioned IQL, learn a task utility value function, use dynamic programming to discover sparse subgoal sequences from robot video datasets, then fine-tune a pretrained video generation model (WAN 2.2 TI2V-5B) to render them. Project page, code, and paper are public.

Related event: Stanford's DreamCan Plans Long-Horizon Robot Tasks with Sparse Keyframes(2 posts)→

Original post →

More from Embodied

Embodied channel →