ReactVAU at ECCV: slow-fast decoupling cuts MLLM calls for streaming video anomaly understanding
CMHungSteven · x · 2026-09-10
ReactVAU, an ECCV paper from National Tsing Hua University and NVIDIA, introduces a slow-fast decoupled framework for causal streaming Video Anomaly Understanding:
- Problem: conventional VAU needs the full video and wakes a heavy MLLM on every normal second, conflicting with real deployment where future frames are unavailable.
- Architecture: a Fast module built on PaliGemma2-3B uses Spatial Grid Folding (four frames at 4 FPS folded into a 2x2 grid) to score every second; persistent memory stores rare cues; the slow reasoning module fires only when the stream looks suspicious.
- Results: follows a causal protocol, achieves competitive detection and descriptions while drastically reducing MLLM calls.
- Code and checkpoints are open-sourced on GitHub and Hugging Face.
More from Research
- Meta's Boxer at ECCV: closing the 3D ground-truth gap with 2D scaling — ducha_aiki · 2026-09-10
- TRL ships 1M-token long-context training guide, trains Qwen3-8B on one 8-GPU node — QGallouedec · 2026-09-10
- SyncWorld turns world models into zero-shot robot simulators via visual calibration — Yuncong Yang · 2026-09-10
- Feng Yao wins ECVA PhD Award at ECCV 2026 for 3D humans + language thesis — Michael_J_Black · 2026-09-10
- Devs call for standardized "model performance across harnesses" evals — zainhas · 2026-09-10
- MIT's Point2Pose tracks unknown objects in 6D with full-occlusion recovery — joemeno · 2026-09-10