MInfoVisQA: 24-language benchmark exposes cross-language robustness gaps in MLLMs

MBZUAI · hf · 2026-11-19

MBZUAI, Georgia Tech, UTokyo and UIUC release MInfoVisQA, a parallel benchmark for information-rich visual QA. It builds 8,960 QA configurations from 128 seed instances across 24 languages by disentangling numerical-structural data from text and programmatically syncing translated labels. Evaluating 25 MLLMs under Language-Aligned QA and Cross-Language QA settings, it reveals substantial robustness gaps when surface languages change.

Original post →

More from Research

Research channel →