RoboAuto: Robot Program Search With Multi-Level Physical Understanding

DJiafei · x · 2026-11-01

A new paper tackles the bottleneck of LLM-based robot self-improvement: existing Code-as-Policy methods rely mostly on execution feedback without truly understanding the physical world. RoboAuto organizes physical understanding at three levels via hierarchical knowledge bases (affordances, spatial relations, action effects), scene grounding, and multi-stage planning that runs self-designed experiments to verify physical effects and test competing hypotheses, reporting superior performance on manipulation tasks.

Original post →

More from Embodied

Embodied channel →