Reconstructing 4D Scenes from Fused 2D Videos

bilawalsidhu · x · 2026-07-15

Using **2D videos from Ray-Ban, GoPro, and iPhone**, a "Terminator-view" **4D scene reconstruction** was achieved **without LiDAR or IMU**. The creator notes the pipeline includes: - Audio waveform sync - **SAM3**-based masking + COLMAP / pi3 solving - **3D Gaussian Splatting** - **Gemini** acting as a hit/miss judge The video walks through the project's origin, control center, the internal 2D-to-4D machine pipeline, training models to "see" the world, and the final results.

Related event: Project IronSight: 4D Scene Reconstruction Without LiDAR(2 posts)→

Original post →

More from Multimodal

Multimodal channel →