Robot AI today: VLA fast-slow stacks converge, on-bot continual learning is the missing piece
PTrubey · x · 2026-09-27
Convergent design
Figure's Helix, Physical Intelligence's π0 and Google DeepMind's Gemini Robotics all use vision-language-action models: a slow "thinking" layer (a multimodal LLM) understands requests, observes the scene and plans; a separate fast control layer issues motor commands many times per second. Bots can converse, decompose "clean up the kitchen" and retry failed grasps.
Training
Mostly imitation learning from human demos (teleoperation plus first/third-person video), with RL layered on top — locomotion mostly in simulation, fine skills increasingly fine-tuned in the real world.
Handling mistakes
- In-context adaptation: the slow layer replans when the cup slips or the drawer sticks — good for reasoning, not permanent learning
- Fleet-level retraining: failures are logged and updates pushed every few weeks, Tesla FSD-style, so every robot benefits from every other's mistakes
- Bolt-on agentic memory handles personalization like "this family keeps pans in the left cabinet"
What's missing
Context-based adaptation works for reasoning but not motor skill. A human fumbles twice with an unfamiliar tool and has it by the third try because their motor system rewires; current robots can't consolidate attempts into lasting skills until the next fleet retrain. Rare, local, site- or body-specific issues are handled badly (the author's Tesla keeps driving over the same road dip too fast).
Whether true on-bot continual learning arrives — and whether it matters — are the trillion-dollar questions in AI robotics today.
More from Embodied
- Meta's new Muse 'charm' is a Tamagotchi-like AI keychain that emails, books trips and shops — nordicinst · 2026-09-27
- Tesla launches new China supply chain audits as Optimus mass production ramps toward 50,000 units — pstAsiatech · 2026-09-27
- Musk predicts 1 billion humanoid robots in 10 years, superhuman AI by 2030 — XFreeze · 2026-09-27
- 'The iPhone isn't a phone anymore' — the pocket computer framing reshapes the AI device debate — jesselyu · 2026-09-27
- Waymo safety data: 82% fewer injury crashes than human drivers across 270M+ miles — SumitGup · 2026-09-27
- whurley assembles Lincoln's first robot, a Reachy Mini from Pollen Robotics — whurley · 2026-09-27