Foundation4D links 3D detections into full-recording tracks, tops NuScenes without retraining

lealtaixe · x · 2026-10-29

NVIDIA's Foundation4D detects 3D objects, estimates velocities, and links detections into tracks across an entire recording. Longer temporal context improves detection without retraining, achieving top results on NuScenes.

The same shared features also predict 3D Gaussians for static scenery and moving actors, letting a reconstruction branch render novel viewpoints without per-scene optimization, unifying perception and scene appearance.

Related event: NVIDIA Research Unveils Foundation4D: LiDAR-Free 4D Perception and Reconstruction from Multi-Camera Video(5 posts)→

Original post →

More from Embodied

Embodied channel →