MATH-IDN: A Multilingual Mathematical Problem Solving Dataset Featuring Local Languages in Indonesia

Read full text Summarise with VIRAT
Authors: Xiao Xiao, Iftitahu Ni’mah, Yuyun Yuyun, Mykola Pechenizkiy, Meng Fang
Cited by: 0
References: 21

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Large Language Models (LLMs) excel at mathematical reasoning in English, but their performance in low-resource languages remains underexplored.This gap is particularly critical in the Indonesian context, where equitable access to AI systems depends on robust multilingual reasoning across diverse local languages.We introduce MATH-IDN, a multilingual benchmark for mathematical problem solving in Indonesian, Javanese, Sundanese, and Buginese, with English as a reference, following the MATH dataset.We evaluate multiple open-source LLMs, including math-specialized, Southeast-Asian-adapted, and general-purpose models, under a zero-shot chain-of-thought setting.Results show that MATH-IDN presents a challenging and discriminative benchmark, revealing substantial performance gaps in lowresource languages, particularly Buginese, and highlighting key limitations in current multilingual reasoning capabilities.1

Fields of Study & Subjects

Topic Modeling Natural Language Processing Techniques Mathematics Computing and Information Processing

Publication details

Journal / source
Findings of the Association for Computational Linguistics: EACL
Pages
4432–4438
Publication date
1 January 2026
Language
EN