Google uses Gemini to spin up training sims from human videos, teaching a humanoid robot cornhole
GoogleAI · x · 2026-10-14
Google AI shared an internal research experiment using Gemini to accelerate robotics work: instead of manually programming training scenarios, the model watches videos of humans performing tasks (like cornhole) and autonomously spins up training simulations.
The released demo shows a humanoid robot studying the videos, running the simulations, and eventually mastering the game of cornhole — a sign that the video-to-sim-to-robot training pipeline is maturing quickly.
More from Embodied
- Recova Trains Robots to Self-Recover in Simulation, Cutting Human Intervention From 87.5% to 0% — Lianhuiq · 2026-10-14
- NVIDIA's AlphaNIST Learns Robotic Assembly From Scratch With Only Binary Rewards, Hitting 98.2% Across 20 Tasks — abhishekunique7 · 2026-10-14
- EU privacy watchdog calls for smart glasses to clearly signal when recording — Polymarket · 2026-10-14
- How Argon drives Spot: real2sim skill verification in MuJoCo and map-free navigation — ki_ki_ki1 · 2026-10-14
- Agent Argon reads Spot's SDK docs itself, builds trash-sorting skill on Boston Dynamics robot — chris_j_paxton · 2026-10-14
- Meta researcher recruiting multimodal and robotics interns for next summer, no background needed — liuzhuang1234 · 2026-10-14