About this paper
MInfoVisQA, a 24-language parallel benchmark, reveals substantial cross-language robustness gaps in multimodal large language models for information-rich visual question answering.
Multimodal large language models (MLLMs) excel in vision-language tasks; yet, whether they maintain consistent understanding of information-rich visuals (InfoVis) when the surface language changes remains unclear. To quantify this capability, we introduce MInfoVisQA, a parallel benchmark with 8,960 QA configurations derived from 128 seed instances across 24 languages. We construct seed-matched, language-parallel visuals and QA pairs by disentangling numerical-structural data from text and programmatically synchronizing translated labels. We evaluate 25 MLLMs under two settings: Language-Aligned QA (LQA, matching visual-text languages) and Cross-Language QA (XQA, fixed QA language with…
multimodal large language models (MLLMs)vision-language tasksMInfoVisQAlanguage-parallel visualsLanguage-Aligned QA (LQA)Cross-Language QA (XQA)cross-language sensitivity metrics
- Upvotes
- 4
- Authors
- 6
- Published
- Oct 14, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
MInfoVisQA: A Multilingual Benchmark for Information-Rich Visual Question Answering was first seen on Hugging Face · Daily papers on Nov 19, 2026. Since then it has appeared in 1 check on 1 different day. Its best position was #26 of 30, reached on Nov 19, 15:29 UTC. It dropped off the list after Nov 19, 15:29 UTC.