NVIDIA releases SimFoundry to turn real-world videos into physics-ready simulations

zhengyiluo · x · 2026-08-16

NVIDIA's GEAR team has released SimFoundry, a real2sim2real framework that automatically converts real-world scenes from images or videos into simulation-ready worlds. It can transform a short video into a physics-ready simulation scene in under an hour, automatically segmenting objects, reconstructing geometry, and generating textured 3D meshes. The output is compiled into an OmniGibson scene with physical parameters. The code is now open-sourced to facilitate foundation model training using synthetic data.

Original post →

More from Embodied

Embodied channel →