MotionForesight: Predicting Future 3D Motion

mangahomanga · x · 2026-07-18

Introducing MotionForesight: repurposing off-the-shelf video models to predict future 3D scene flow after short video context. - Trained on only 40K RGB human interaction videos, yet generalizes to novel home/office scenes. - Core idea: leverage temporal priors from pretrained video models, no language or action labels. - Authors built on TrackCraft3r (a dense 3D tracker on Wan2.1) with lightweight LoRA adaptation, using observed RGB and geometry to predict future object motion.

Related event: MotionForesight predicts future 3D motion from existing video models(6 posts)→

Original post →

More from Research

Research channel →