Unitree Go2 robot asks clarifying questions via Gemini and Bayesian active learning

DynamicWebPaige · x · 2026-11-10

DynamicWebPaige (Google) spotlights a conference project giving robots the sense of when to ask a clarifying question: Gemini Pro and Flash-Lite with Bayesian active learning disambiguate human intent in real time on a Unitree Go2 quadruped. The paper's framework: an LLM proposes candidate task specs with priors, a Grammar VAE embeds them in latent space, a Gaussian Process models utility, and the acquisition function picks the most informative contrast to phrase as a clarification question; the converged spec is decoded for a formal planner with a safety filter.

She also highlights SimFoundry from Fei-Fei Li's team: Gemini handles scene layout and object articulation while NanoBanana generates assets, automatically producing interactive 3D simulation scenes for policy learning.

Related event: Google Combines Gemini with Bayesian Active Learning So Robot Dogs Ask Clarifying Questions(2 posts)→

Original post →

More from Embodied

Embodied channel →