Puffin-World: unified world model with native 3D states, open-sourced with 16M dataset

ccloy · x · 2026-09-10

Researchers from NTU S-Lab, University of Michigan, Beijing Jiaotong University and ACE Robotics released Puffin-World, a unified multimodal world model representing the physical world via three native states—physics, geometry and appearance—unifying gravity-aware camera understanding, free-viewpoint simulation, 3D world generation/reconstruction and closed-loop exploration in one model. The open release includes code, models and the Puffin-16M dataset: 15M vision-language-camera triplets, 1M camera trajectories, and camera-grounded annotations for 44.5M images across 28 public datasets. An interactive demo lets users explore generated worlds with appearance, gravity and dense depth side by side.

Original post →

More from Embodied

Embodied channel →