Reconstructing 4D Scenes from Fused 2D Videos
bilawalsidhu · x · 2026-07-15
Using 2D videos from Ray-Ban, GoPro, and iPhone, a "Terminator-view" 4D scene reconstruction was achieved without LiDAR or IMU.
The creator notes the pipeline includes:
- Audio waveform sync
- SAM3-based masking + COLMAP / pi3 solving
- 3D Gaussian Splatting
- Gemini acting as a hit/miss judge
The video walks through the project's origin, control center, the internal 2D-to-4D machine pipeline, training models to "see" the world, and the final results.
Related event: Project IronSight: 4D Scene Reconstruction Without LiDAR(2 posts)→
More from Multimodal
- Adobe Firefly video editor walkthrough: one-sentence Quick Cut turns 32s into 20s — LudovicCreator · 2026-10-26
- Hi3D V1.0 open-sourced with 2M training assets and 90% slicing success rate — kimmonismus · 2026-10-26
- Claude Can Replace Your YouTube Thumbnail Designer in 10 Minutes — thedankoe · 2026-10-26
- Multimodal AI Is Not Useless: A Practitioner Pushes Back on Growing Skepticism — thoma_gu · 2026-10-26
- One prompt, full Blender animation: dev says he never touched Blender once — iamfakhrealam · 2026-10-26
- Dense instance segmentation via Muse Wonder + SAM 3.1 on Meta's Model API — nikhilaravi · 2026-10-26