From Curated Data to Scalable Models: Continual Pre-training of Dense and MoE Large Language Models for Tibetan

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) 2026 Open access

Read full text
Authors: Leiyu Pan, Leiyu Pan, Bojian Xiong, Renren Jin, Shaowei Zhang, Yue Chen, Ling Shi, Zhou Jiang, Junru Wu, Zhen Wang, Jianxiang Peng, Juesi Xiao
+5 more Tianyu Dong, Zhuowen Han, Zhuo Chen, Yuqi Ren, Deyi Xiong
DOI: 10.18653/v1/2026.acl-long.1866
Cited by: 0

Abstract

Lei Yang, Leiyu Pan, Bojian Xiong, Renren Jin, Shaowei Zhang, Yue Chen, Ling Shi, Jiang Zhou, Junru Wu, Zhen Wang, Jianxiang Peng, Juesi Xiao, Tianyu Dong, Zhuowen Han, Zhuo Chen, Yuqi Ren, Deyi Xiong. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026.

Fields of Study & Subjects

Natural Language Processing Techniques Topic Modeling Computational and Text Analysis Methods

Publication details

Journal / source
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Publisher
Association for Computational Linguistics
Pages
40167–40182
Publication date
1 January 2026
Language
EN