Niantic's Object Interaction Makes Gaussian Splat Scenes Editable and Physics-Ready

lukas_m_ziegler · x · 2026-11-17

Niantic Spatial launched Object Interaction (beta), addressing Gaussian splatting's key limitation: photoreal captures are frozen, with no separate objects, collisions, or physics—useless for robot training.

The feature scans captures to identify whole movable objects, extracting each while preserving visual appearance and picking up collision information. After a quick review, objects become selectable, movable, or removable with simplified physical properties—turning a captured room from a fixed layout into an interactive sim environment where chairs slide and equipment shifts.

Original post →

More from Embodied

Embodied channel →