Motion direction forms a ring in a video model’s activation space
mathemagic1an · x · 2026-07-29
A follow-up to the video-world-models interpretability work shows that motion direction forms a ring-shaped manifold in the model’s activation space.
- Averaging block-5 activations by motion direction and projecting them with PCA produces a circular structure.
- Nearby directions in the physical world remain neighbors in activation space.
- The key point is that the model never saw a controller or explicit actions—only pixels—yet a steerable motion representation still emerges.
Related event: 4M-Parameter Pixel Transformer Emerges as Physical World Model(10 posts)→
More from Research
- Transforming quadruped robot runs on real hardware: per-pose RL policies in Isaac switched on morph — _Stocko_ · 2026-10-16
- KinoGen synthesizes robot loco-manipulation reference motions directly via kinematically grounded video generation — ChongZzZhang · 2026-10-16
- Science Robotics paper introduces F³, predictive event-based vision beyond optical flow — CSProfKGD · 2026-10-16
- VideoGen-Agent: An 8B Multimodal Agent Turns Video Generation Into a Tool-Use Loop — jiqizhixin · 2026-10-16
- Comprehension Audits: New Paper Proposes a Gate for AI-Written Code at Frontier Labs — ronbodkin · 2026-10-16
- Not Boring #215: Cammarata's Clean Networks Claim, Tesla's Flying Roadster, Tau Cut 73% — Not Boring (Packy McCormick) · 2026-10-16