Foundation4D recovers metric depth, extrinsics and ego-motion from multi-camera video

lealtaixe · x · 2026-10-29

A Foundation4D branch recovers metric depth, multi-camera extrinsics, and ego-motion from multi-camera video. Factorized attention combines views and time efficiently, and global pose optimization turns local predictions into coherent camera trajectories.

This is the camera calibration and self-motion estimation core of NVIDIA's Foundation4D framework.

Related event: NVIDIA Research Unveils Foundation4D: LiDAR-Free 4D Perception and Reconstruction from Multi-Camera Video(5 posts)→

Original post →

More from Embodied

Embodied channel →