Fysiverse-3D-Vision report: generating executable 3D worlds from a single image

teortaxesTex · x · 2026-10-29

A technical report from Fysics AI with Fudan, CUHK and Tongji presents Fysiverse-3D-Vision (arXiv:2609.25741), a unified vision-language-geometry framework that reconstructs executable 3D scenes from a single image. It decouples spatial layout reasoning from asset synthesis, fusing textual supervision, semantic cues and geometric representations in one Transformer, with an object-conditioned layout module predicting translation/rotation/scale via cross-attention, plus collision-aware refinement for physical consistency. It extends to part-level interactive scene reconstruction and beats prior methods on geometric consistency, layout estimation and rendering quality. Reposter teortaxesTex quipped the "Fysiverse" name may be too ambitious.

Original post →

More from Multimodal

Multimodal channel →