World model that predicts the future directly in 3D, fully open-sourced

YunzhuLiYZ · x · 2026-11-03

The lead of the 3D World Simulator project explains the motivation: today's world models are mostly video models that look realistic but don't explicitly model the underlying 3D scene. The team instead trained a model to predict the future directly in 3D, with long-term stability comparable to video world models. The predicted 3D scene can be rendered from any camera angle with consistent views, and supports background swaps, different robot embodiments and tactile data. Project website and code are released open-source.

Original post →

More from Embodied

Embodied channel →