MMTabReal: Real-World Benchmark for Multimodal Table Understanding

Read full text
Authors: Prasham Titiya, Jainil Trivedi, Chitta R. Baral, Vivek Gupta
Cited by: 0

Abstract

Multimodal tables i.e. tabular layouts interleaved with charts, maps, icons, and color encodings are ubiquitous in real applications yet remain difficult for Multimodal Large Language Models (MLLMs).Despite advances in text and image understanding, systematic evaluation of table-centric multimodal reasoning is limited.We introduce MMTABREAL, a MultiModal Table Benchmark, human-curated suite of 500 real-world tables paired with 4,021 question-answer pairs.MMTABREAL spans four question types, five reasoning categories, and eight structural archetypes.Evaluations of state-of-the-art models reveal substantial gaps, especially in visual grounding, spatial alignment, and multi-step inference, with 20-40% performance drops relative to existing benchmarks.These results highlight the need for architectures that more tightly fuse vision with tabular structure and support explicit numeric/logical operations.MMTABREAL is released for evaluation only, providing a rigorous, reproducible testbed that reflects the linguistic, structural, and reasoning complexity of real-world multimodal tables.Code and data are available at

Fields of Study & Subjects

Multimodal Machine Learning Applications Topic Modeling Natural Language Processing Techniques

Publication details

Journal / source
Findings of the Association for Computational Linguistics: ACL 2026
Publisher
Association for Computational Linguistics
Pages
41156–41176
Publication date
1 January 2026
Language
EN