3D World Simulator Debuts: Interactive World Model Predicting Appearance, Geometry and Tactile at 50+ FPS

A research team has released 3D World Simulator, an interactive world model (published by jwang771, shared by YunzhuLiYZ) that runs at 50+ FPS (50Hz) on a single RTX 5090. It is open source with a web demo available. The work has drawn attention for jointly predicting multiple modalities in an explicit 3D representation space and is seen as a strong step toward robotics and world simulation.

Confirmed

• The model predicts in a unified 3D representation space (point clouds, voxels, and 3D Gaussians), simultaneously generating novel-view appearance, multi-view consistent RGB-D, 3D geometry, and spatially aligned tactile signals.
• Supports 50Hz interactive long-horizon world simulation, handling rigid, articulated, and deformable object tasks including cloth folding, part assembly, and rope threading; the sharer praised its cloth physics.
• Emphasizes the controllability advantages of explicit 3D representations.

Why it matters

• Unifying appearance, geometry, and touch in a single world model provides an interactive simulation environment for robotic manipulation, and real-time performance on a single consumer GPU lowers the barrier for research and experimentation.

2026-11-03 ~ 2026-11-03 · 5 related posts

• [source] 3D World Simulator predicts appearance, geometry and touch at 50+ FPS on an RTX 5090 — YunzhuLiYZ · 2026-11-03
• [source] 3D World Simulator jointly predicts appearance, geometry and touch at 50Hz — XRarchitect · 2026-11-03

3 near-duplicate retellings: YunzhuLiYZ · YunzhuLiYZ · YunzhuLiYZ