Direct3D-V3: latent-free diffusion transformers generating 3D directly in the native voxel domain

NJU · hf · 2026-11-20

Direct3D-V3 proposes a latent-free diffusion transformer framework that discards the VAE entirely and operates directly on raw SDF voxel grids during both training and sampling.

For geometric reliability:

The latent-free design removes the reconstruction bottleneck and yields meshes with substantially richer local detail. Predicted cameras and native SDF output also enable generative reconstruction, interleaving diffusion with normal-guided refinement while the generative prior completes unseen regions. Authors are from Nanjing University, HKU, Oxford and DreamTech.

Original post →

More from Multimodal

Multimodal channel →