MIT's Phillip Isola: Cloud LLMs Could Soon Puppeteer Connected Robots

Justgototheeffinmoon · reddit · 2026-09-08

MIT professor Phillip Isola argues in a short essay that many LLMs will be tested as robot-use agents this year—a model driving a robot body the way it now drives a browser.

He acknowledges standing objections (latency, weak spatial reasoning, thin physical intuition) but says these are melting away with newer models like Fable and Astra. His core point is a distribution shift, not a capability jump: robot intelligence today lives on-device per hardware line, with researchers split across world models, behavior foundation models, and continual learning—cloud puppeteering skips all of it. "Every robot with an internet connection becomes a potential tool; a car might be as easily controlled as a factory arm."

He concedes LLM-controlled robots remain far less performant and reliable than dedicated solutions, especially for safety-critical use. No demos, no benchmarks—this is a positioning argument about where the robotics stack may fracture.

Original post →

More from Embodied

Embodied channel →