HomeBody gives VLMs persistent spatial memory: Unitree G1 cleans a kitchen with no task-specific training

rsasaki0109 · x · 2026-10-12

HomeBody equips frontier VLMs (e.g. GPT Astra) with persistent spatial memory and composable humanoid skills for long-horizon tasks. In a previously unseen kitchen, a Unitree G1 guided by GPT Astra cleaned up across the room and retrieved a remembered object from an underspecified request — no environment-specific training data or extra policy learning.

Pipeline (per diagram): exploration driven by Astra collects scene data via iPhone video, SLAM+depth and joint states; a Real2Sim Agent reconstructs the scene in IsaacLab/MuJoCo/Blender. Then the robot executes "clean up the kitchen": pick and stow the coffee bag, navigate from memory to the milk carton, pick it, and drop it in the bin.

Related event: Stanford's HomeBody Gives VLM-Powered Humanoids Spatial Memory(2 posts)→

Original post →

More from Embodied

Embodied channel →