Large multimodal models for low-resource languages: A survey

Read full text
Authors: Marian Lupaşcu, Ana-Cristina Rogoz, Mihai‐Sorin Stupariu, Radu Tudor Ionescu
Cited by: 9
References: 35

Abstract

• Represents the first comprehensive analysis of LMMs specifically focused on LR languages. • Provides a novel taxonomy that categorizes existing approaches into six main categories. • Systematically organizes the literature to enable a clear understanding of current approaches and remaining challenges. • Provides an open-source repository that includes implementation details, datasets, and benchmarks. In this survey, we systematically analyze techniques used to adapt large multimodal models (LMMs) for low-resource (LR) languages, examining approaches ranging from visual enhancement and data creation to cross-modal transfer and fusion strategies. Through a comprehensive analysis of 117 studies across 96 LR languages, we identify key patterns in how researchers tackle the challenges of limited data and computational resources. We categorize works into resource-oriented and method-oriented contributions, further dividing contributions into relevant sub-categories. We compare method-oriented contributions in terms of performance and efficiency, discussing benefits and limitations of representative studies. We find that visual information often serves as a crucial bridge for improving model performance in LR settings, though significant challenges remain in areas such as hallucination mitigation and computational efficiency. In summary, we provide researchers with a clear understanding of current approaches and remaining challenges in making LMMs more accessible to speakers of LR (understudied) languages. We complement our survey with an open-source repository available at: https://github.com/marianlupascu/LMM4LRL-Survey .

Fields of Study & Subjects

Topic Modeling Speech and dialogue systems Natural Language Processing Techniques

Publication details

Journal / source
Information Fusion
Publisher
Elsevier BV
Volume
131
Pages
104189–104189
Publication date
28 January 2026
Language
EN