Jitendra Malik pushes back on Isola: LLMs can't handle high-frequency robot control
sainingxie · x · 2026-09-08
Jitendra Malik disagrees with Phillip Isola on LLMs for robot control: locomotion needs high-frequency policies dealing with forces and contacts. He challenges Isola to implement quadruped locomotion policies (RSS 2021/CoRL 2022) in an LLM, arguing quasi-static manipulation ≠ dexterity; LLMs can do high-level planning but that's not the hard part. The linked CoRL 2022 Best Systems Paper is an end-to-end egocentric-vision quadruped locomotion policy (single front depth camera, sim-trained, zero fine-tuning transfer) crossing stairs, gaps and stepping stones.
Related event: Malik and Isola Debate Whether LLMs Can Control Robots(4 posts)→
More from Embodied
- Full teardown: inside Zmotor's 32mm linear actuator for humanoids — MarwaEldiwiny · 2026-10-27
- Full Teardown of a Zmotor Linear Actuator Used in China's Humanoid Robots — MarwaEldiwiny · 2026-10-27
- World Model Assigns Weight and Friction to Objects, Then Simulates with a Physics Engine — jonstephens85 · 2026-10-27
- First unboxing shots of Apple's foldable "iPhone Duo" surface — chrisfirst · 2026-10-27
- Bedrock Robotics Raises $600M Series C as Autonomous Excavators Do Paid Work on US Job Sites — davidpattersonx · 2026-10-27
- UniAction: unified action conditioning lets one world model handle mixed action types — ZeYanjie · 2026-10-27