Jitendra Malik: robots ignoring 3D structure are wasting a valuable signal
JitendraMalikCV · x · 2026-09-21
Berkeley's Jitendra Malik reflects on 3D/4D reconstruction — from photogrammetry and multi-view geometry (Hartley & Zisserman) to deep learning era systems like VGGT and SAM 3D that incorporate recognition-driven shape priors. He argues this directly matters for robotics: many learning-era robotics papers ignore 3D structure, 'wasting valuable signal' in a field where robots operate in the 3D world. He cites his group's long real2sim2real tradition, welcomes renewed interest sparked by Astra, and asks that human researchers get credit, not just AI models.
Related event: Jitendra Malik: Robots Discarding 3D Structure Are Wasting Valuable Signals(3 posts)→
More from Embodied
- Open-source dual-arm robot solves tangram puzzles with 90 demos, ~60% success — DanGrover · 2026-11-12
- Robotics has three regional playbooks: China volume, Europe inspection, US pilots — ingliguori · 2026-11-12
- 3,500 Laser-Armed AI Submarine Robots Patrol Norwegian Salmon Farms — philfung · 2026-11-12
- Model Autonomously Designs a Surgical-Robot-Style Robotic Arm CAD After 75 Minutes — _Stocko_ · 2026-11-12
- Dev releases local world model turning any image into interactive video, runs on RTX 3060 — lucidml_lover · 2026-11-12
- RoboRisk benchmark shows foundation models pose high harm rates in robotics; LEASH harness cuts risk — UoLiverpool · 2026-11-12