Domain-Adaptive Multitask BERT with Graph Context Modeling for Code-Mixed Hinglish Sentiment Classification

Read full text
Authors: Rahul Mishra, A. Kaliappan, Sarala D V, T. V. Hyma Lakshmi, Prabhat Kumar Ravi, Y Harika Devi, Satyajee Srivastava, Deepak Suresh Asudani, Sanath Nagaraj, Yogesh Harishchandra Bhosale
Cited by: 0
References: 17

Abstract

Hinglish, a widely used Hindi–English code-mixed language on social media, presents unique challenges for sentiment analysis due to transliteration variability, script mixing, and inconsistent grammar. To address these issues, this study proposes the Cross-Lingual Domain-Adaptive Multitask Graph-Enhanced Bidirectional Encoder Representations from Transformers (CDMG-BERT), tailored for code-mixed sentiment classification. The model integrates four key components: English-to-Hinglish embedding alignment, domain-adversarial training using 92k English samples, multitask learning with auxiliary POS tagging, and graph-based token relational modeling for long-range contextual refinement. Experimental results on a 12,000-sample IIT Bombay Hinglish dataset show that CDMG-BERT outperforms mBERT, XLM-R, and deep learning baselines, with an F1-score of 84.8%. Ablation analysis suggests that each architectural module works well, with cross-lingual alignment and domain adaptation providing the largest gains. These results demonstrate that the model is robust enough to handle spelling differences, code-mixing intensity, and inconsistencies between the Roman and Devanagari scripts. This makes CDMG-BERT a good choice for sentiment analysis in a multilingual environment with limited resources.

Fields of Study & Subjects

Sentiment Analysis and Opinion Mining Topic Modeling Hate Speech and Cyberbullying Detection

Publication details

Journal / source
Engineering Technology & Applied Science Research
Volume
16
Issue
1
Pages
32336–32341
Publication date
9 February 2026
Language
EN