30,000 hours of egocentric video: world model learns hands, not object outcomes

xuanalogue · x · 2026-10-13

Training a world model on 30,000 hours of first-person video, Jiahua Dong's team found it learned where hands go but far less about what happens to objects they touch. Scaling from 300 to 30,000 hours didn't narrow the gap, and a 4× larger model barely helped. Tonghe Zhang argues this quantitatively disproves claims that scaling video data solves robotics: POMDPs contain states that can never be decoded from observations.

Original post →

More from Embodied

Embodied channel →