A Systematic Comparison of Parameter-Efficient Fine-Tuning Techniques for Low-Resource Neural Machine Translation: Evidence from Indigenous Languages of the Americas

Read full text
Authors: Drew Stackhouse, Justin Debenedetto
Cited by: 1

Abstract

We present the first systematic benchmark of parameter-efficient fine-tuning (PEFT) for lowresource neural machine translation (NMT) of indigenous languages of the Americas.We evaluate eight PEFT methods alongside full fine-tuning on NLLB-200-distilled-600M across 13 indigenous-to-Spanish language pairs spanning four resource tiers (357-125,008 training sentences).OFT (Orthogonal Finetuning) achieves the highest development-set chrF++ among PEFT methods (26.63) while training only 0.28% of parameters.LoRA (Low-Rank Adaptation) offers a strong efficiency-quality tradeoff (25.27 chrF++, 0.19%).On held-out test data, full fine-tuning ranks first (25.12)with OFT a close second (25.06; p = 0.43).VeRA (Vector-based Random Matrix Adaptation) and Prefix Tuning consistently underperform.These results demonstrate that PEFT is a viable alternative to full fine-tuning for indigenous-language NMT.

Fields of Study & Subjects

Natural Language Processing Techniques Language and cultural evolution Big Data and Digital Economy

Publication details

Journal / source
Proceedings of the Sixth Workshop on NLP for Indigenous Languages of the Americas (AmericasNLP)
Publisher
Association for Computational Linguistics
Pages
33–45
Publication date
1 January 2026