4DAnyone: Reconstruct a 4D human from a casual phone video, no rig needed

anselm · x · 2026-08-31

4DAnyone (Zhejiang University, Ant Group et al., SIGGRAPH Asia 2026) reconstructs a 4D Gaussian Splatting volumetric human from a single casually captured monocular video — no rig, no calibration, no tripod.

Traditional photorealistic 4D human capture requires a calibrated synchronized camera array; this work instead generates the videos such an array would have recorded.
Key challenge is consistency at scale: Reference Context Packing (RCP) compresses linearly growing reference context into a fixed budget, while Target Context Routing (TCR) routes context across disjoint generation groups to prevent structural drift; a 3D skeleton supplies sparse-but-accurate conditioning.
Generalizes robustly to dance, sports, stage, speech and fashion footage, tolerating mild camera motion and unknown intrinsics/poses.
Paper, code and models are released.

Original post →

4DAnyone: Reconstruct a 4D human from a casual phone video, no rig needed

More from Multimodal