SPW-Nav streams one minute of 2K 360° video in real time from a single panorama

AlayaLab · hf · 2026-10-09

AlayaLab proposed SPW-Nav, a language-guided streaming panoramic world model that interprets movement instructions and streams one minute of 2K 360° video in real time from a single panorama.

Method: each instruction is interpreted as camera motion in the previously generated panorama; spherical rotation decoupling applies rotation exactly on the sphere, pose-aligned conditioning keeps translation inputs bounded over long streams, and multi-term memory with a few-step generator continues scenes as instructions change. The authors also release SPW-NavSet, panoramic videos with camera trajectories and verified instructions.

Applications include interactive 3D scene exploration, VR, and embodied agent training. SPW-Nav outperforms prior panoramic generators in camera-following accuracy and video quality, and supports on-the-fly instruction switching.

Original post →

More from Multimodal

Multimodal channel →