ReactVAU at ECCV 2026: fast-slow streaming video understanding cuts heavy MLLM calls
CMHungSteven · x · 2026-09-10
Presented at ECCV 2026 in Malmö, ReactVAU is a causal framework for streaming video understanding that avoids peeking at the future and avoids waking a heavy MLLM every normal second.
Design:
- An always-on fast detector monitors every frame;
- Persistent memory captures rare cues;
- Slow LLM-based reasoning fires only when the stream looks suspicious.
Under a causal protocol it achieves competitive detection and description performance with far fewer MLLM calls. Paper, code, weights, and demo are public; a joint NVIDIA × NTHU team effort, poster Thursday Sep 10, 16:30–18:30 CEST.
More from Research
- Researcher flags unresolved data transparency issues in compositionality evals — najoungkim · 2026-10-27
- Separate Forms from Estimators: Why Steer by Difference of Means When You Can Use SGD? — johnhewtt · 2026-10-27
- EMNLP paper probes why some LLM biases survive rewording while others don't — radamihalcea · 2026-10-27
- Datology webinar: Curation Studio matched top data baselines with under 20% compute — josh_wills · 2026-10-27
- KANLab: an interactive browser playground for Kolmogorov-Arnold Networks — Lukas Niehaus · 2026-10-27
- CMU's LLM2Cert synthesizes stability certificates verified via SMT and Lean — CarnegieMellonU · 2026-10-27