Reconstructing 4D Scenes from Fused 2D Videos
bilawalsidhu · x · 2026-07-15
Using 2D videos from Ray-Ban, GoPro, and iPhone, a "Terminator-view" 4D scene reconstruction was achieved without LiDAR or IMU.
The creator notes the pipeline includes:
- Audio waveform sync
- SAM3-based masking + COLMAP / pi3 solving
- 3D Gaussian Splatting
- Gemini acting as a hit/miss judge
The video walks through the project's origin, control center, the internal 2D-to-4D machine pipeline, training models to "see" the world, and the final results.
Related event: Project IronSight: 4D Scene Reconstruction Without LiDAR(2 posts)→
More from Multimodal
- FLUX.2 Klein Drifts Hard on Character Expressions While Free Gemini Holds Likeness — wacomlover · 2026-09-11
- Tencent Hunyuan releases AuK code and weights on GitHub with ComfyUI and fine-tuning support — aigclink · 2026-09-11
- Creator turns Bahamut vs Tiamat rivalry into an AI cinematic battle with Midjourney, GPT Image 2 and Seedance — azed_ai · 2026-09-11
- invideo launches AI agent-powered editor to automate repetitive editing tasks — azed_ai · 2026-09-11
- fable 5.1 recreates The Starry Night with 256,157 JavaScript brush strokes — cedric_chee · 2026-09-11
- GPT-6 Astra + Hyper3D Rodin MCP Generates 3D Assets in One Agent Flow — ahuja_priyank · 2026-09-11