3D World Simulator predicts appearance, geometry and touch at 50+ FPS on an RTX 5090

YunzhuLiYZ · x · 2026-11-03

Researchers unveiled 3D World Simulator, an interactive world model running at 50+ FPS on an RTX 5090. It jointly predicts appearance, geometry, and touch in a unified 3D space, generating novel-view appearance, multi-view consistent RGB-D, 3D geometry, and spatially aligned tactile signals. It handles rigid, articulated, and deformable objects (cloth folding, part assembly, rope threading), offers camera-view controllability, and composes learned interaction dynamics with Gaussian backgrounds and kinematic robot models—aimed at scalable robot policy learning and evaluation. Playable online now.

Original post →

More from Embodied

Embodied channel →