Google's VIS-Ground adds contextual grounding to interactive video storytelling

GoogIe · hf · 2026-10-13

Researchers from Google, UIUC, and UCLA introduce VIS-Ground, tackling contextual grounding in video interactive storytelling: viewer requests can depend jointly on a grounding source, rendered video state, and new intent. The method formulates grounding as converting heterogeneous context into an executable constraint model via Structured Context Abstraction, Generation Constraints Induction, and Constrained Video Generation (planning, verification, revision, rendering). Across three video backbones it achieves the best composite scores, averaging +10.3 absolute points over the strongest per-backbone baselines.

Original post →

More from Multimodal

Multimodal channel →