Google AgentHands: AI agents with synchronized speech gestures in XR

dl_weekly · x · 2026-09-01

Google XR introduced AgentHands, a research prototype published at CHI 2026. It uses an LLM to generate interactive hand gestures synchronized with speech for conversational agents, providing spatially grounded guidance. This approach significantly improves spatial grounding and warning salience compared to speech-only baselines, making conversations about physical surroundings more intuitive.

Original post →

More from Multimodal

Multimodal channel →