Interactive 3D World Simulator runs at 50+ FPS on an RTX 5090, outputs RGB-D and tactile signals

YunzhuLiYZ · x · 2026-11-03

Researchers introduced a 3D World Simulator, an interactive world model running at 50+ FPS on a single RTX 5090, playable in-browser now. It predicts in a unified 3D representation space, jointly generating novel view appearance, multi-view consistent RGB-D, 3D geometry, and spatially aligned tactile signals. UC Berkeley's Ken Goldberg amplified it with a prediction: just as RL environments were critical for VLM capabilities (e.g., Blender for 3D), scalable sim and action-conditioned world models will become increasingly central to robot capabilities.

Related event: 3D World Simulator Debuts: Interactive World Model Predicting Appearance, Geometry and Tactile at 50+ FPS(5 posts)→

Original post →

More from Embodied

Embodied channel →