Google and UCSB introduce StreamVibe: proactive video agents for evolving intent

xwang_lk · x · 2026-10-28

Google, UC Santa Barbara and collaborators introduce StreamVibe, research on proactive video agents that help at the right moment without being asked. Three components: StreamVibe-VL (learns when/how to help), StreamVibe-Harness (tracks evolving intents and task progress), and StreamVibe-Bench (evaluates proactive assistance in long-horizon interactions). Built on 183.4 hours of video, 4,100 evaluation samples, 20,546 annotated help points, 85K training samples, and 10 intent subtypes across explicit, implicit, and mid-task-revised intent levels. Code and paper to be released in 7 days pending approval.

Related event: Google and partners unveil StreamVibe, a proactive streaming video agent(3 posts)→

Original post →

More from coding & agent

coding & agent channel →