General-purpose LLM beats specialized robot models on arm control, signaling robotics' bitter lesson

zakkohane · x · 2026-11-02

Zak Kohane argues the bitter lesson is arriving in robotics: a general-purpose LLM (ChatGPT Astra) given a robotic arm and camera outperforms state-of-the-art specialized robot models trained on thousands of hours of video. Key enabler is "geometric prompting" — supplying the arm's specs unlocks fast learning, with big implications for RL transfer in domains like medicine. His headline takeaway: orchestrated agents underperform an unconstrained agentic policy.

Related event: OpenAI's Astra Beats Specialized Robot Models Zero-Shot, Sparking "Specialized ML Is Dead" Debate(15 posts)→

Original post →

More from Embodied

Embodied channel →