NVIDIA Releases Foundation4D, a Unified 4D Perception Model That Ditches Lidar

jonLorraine9 · x · 2026-10-30

NVIDIA released Foundation4D, a unified 4D perception foundation model for understanding and reconstructing driving scenes. From camera input alone it generates depth, camera poses, 3D objects, occupancy, and Gaussian splats — camera-based annotations for training plus Omniverse NuRec reconstruction, simplifying dataset preparation without lidar.

Team member lealtaixe highlighted the appeal of one model with shared video features supporting multiple scene-understanding outputs.

Related event: NVIDIA Research Unveils Foundation4D, a Unified Camera-Only 4D Perception and Reconstruction Model(6 posts)→

Original post →

More from Embodied

Embodied channel →