Astra shows any 3D/4D prior can be distilled into VLMs, a new embodied AI paradigm
mariyaivasileva · x · 2026-09-21
Jitendra Malik highlights that 3D/4D reconstruction — from multi-view geometry to VGGT and SAM 3D — is directly relevant to robotics, arguing that learning-era robotics papers ignoring 3D structure waste valuable signal. Commentators note Astra's key takeaway: virtually any 3D/4D prior can be distilled into VLMs, a potential new paradigm for embodied AI built on a real2sim2real tradition.
Related event: Jitendra Malik: Robots Discarding 3D Structure Are Wasting Valuable Signals(3 posts)→
More from Embodied
- Anduril exec: factories use little automation since it can't handle low-volume, high-complexity lines — AnneliesGamble · 2026-11-12
- Walden Robotics' Sage model quadruples robot uptime on Toyota factory lines — adnothing · 2026-11-12
- Robotics debate: matching training to test distribution is not the best approach, says researcher — EpisodeYang · 2026-11-12
- Deployment is where physical AI grows up — and its most important data source, per Tedrake's CoRL talk — m_wulfmeier · 2026-11-12
- Runway teases triple bet: real-time avatars, interactive worlds, robot action models — c_valenzuelab · 2026-11-12
- WICL: robots learn manipulation in-context, 83.4% success on all 50 RoboTwin tasks — _akhaliq · 2026-11-12