VIABench Evaluates Visual Assistance Capabilities
NJU · hf · 2026-07-17
The research team introduces VIABench, a comprehensive video benchmark designed for visual assistance scenarios, featuring first-person perspective videos recorded or shared by visually impaired individuals. It specifically evaluates the capabilities of multimodal large models in real-world assistive tasks, covering three core categories:
- Proactive Alerting: Identifying continuous content in videos and providing advance warnings for upcoming navigation critical events.
- Visual Question Answering: Answering user questions about the environment or objects.
- Guided Interaction: Completing intentional interactions between the user and the environment based on context.
The authors also designed a rigorous evaluation pipeline supporting both online and offline modes. Experimental results show that current multimodal large models still exhibit significant shortcomings in real-world visual assistance, particularly in proactive alerting tasks requiring anticipation and real-time responses. Code and data will be open-sourced.
More from Multimodal
- 3D ResNet Paper Crosses 3,000 Citations Eight Years After CVPR 2018 — HirokatuKataoka · 2026-09-11
- Non-coder builds full-featured Android ComfyUI client with ChatGPT, submits to Google Play — ComfierUI · 2026-09-11
- FastH3-Live hits 22fps: acceleration node benchmarks and the --vram-headroom trick — spartong945 · 2026-09-11
- Midjourney style code share: --sref 2912175708 — tisch_eins · 2026-09-11
- Astra storyboards plus Minimax H3 per-shot generation boost video success rates — Hailuo_AI · 2026-09-11
- MiniMax H3 MAX nails cooking anime clips: 15-second curry demo with prompts shared — Hailuo_AI · 2026-09-11