LLMs' best robotics role: generating controllers to pretrain robot models

igilitschenski · x · 2026-09-09

Igor Gilitschenski argues that if LLMs excel at generating code to control robots, their best use is producing controllers and, downstream, training data for pretraining robot models — mirroring how LLMs already interface with game/physics engines to generate training data for video models. The framing positions LLMs as a data flywheel for embodied AI rather than direct policy networks.

Related event: MIT Researcher: LLMs May Be Best at Generating Robot Pretraining Data(2 posts)→

Original post →

More from Embodied

Embodied channel →