RealMe Turns Sparse 720p Multi-View Captures into 2K Volumetric Video with Video Diffusion

zju3dv · hf · 2026-10-22

Zhejiang University's CAD&CG lab and 4DV.ai present RealMe, which enhances sparse, low-resolution multi-view captures into high-resolution, 4D-consistent volumetric video. It uses a video diffusion model with layout-aware attention and frequency-domain latent supervision, upscaling 720p sparse views to 2K volumetric output.

Original post →

More from Multimodal

Multimodal channel →