Google Introduces AgentHands: Gesture-Enabled XR Conversational Agents

CurieuxExplorer · x · 2026-08-28

Google Research released AgentHands, an XR research prototype that augments conversational agents with synchronized, expressive hand gestures. Powered by LLMs, the system leverages spatial understanding to generate speech-accompanying hand movements in 3D environments, transforming abstract verbal instructions into intuitive physical demonstrations. This research, accepted at CHI 2026, aims to bridge the mental mapping gap and enhance user engagement in physical tasks.

Original post →

More from Embodied

Embodied channel →