CROSS-ATTENTIVE MULTIMODAL TRANSFORMER ARCHITECTURE FOR MENTAL HEALTH DISORDER DETECTION FROM TEXT
Abstract
Mental health disorders such as depression, anxiety, and stress increasingly manifest through language used in digital communication.Leveraging Natural Language Processing (NLP) for automated detection offers a scalable alternative to conventional clinical assessments.This paper proposes a Cross-Attentive Multimodal Transformer Architecture that integrates BlueBERT for semantic representation, EmotionBERT enhanced with BiLSTM-CNN for emotional modeling, and VADER for sentiment polarity estimation.A cross-attention mechanism aligns emotional and sentiment-derived features with clinical semantics to improve contextual understanding.To address class imbalance, the dataset is reformulated into a balanced distribution using stratified sampling and targeted augmentation.Training employs Focal Loss with class weights, AdamW optimization, and mixed-precision acceleration.Experimental evaluation on the balanced dataset achieves 92% accuracy and a 0.92 macro F1-score, demonstrating substantial improvement over unimodal baselines and imbalanced training settings..The results highlight the effectiveness of attention-based multimodal fusion for reliable mental health disorder detection.
Fields of Study & Subjects
Mental Health via Writing
Sentiment Analysis and Opinion Mining
Emotion and Mood Recognition
Publication details
- Journal / source
- International Research Journal of Modernization in Engineering Technology and Science
- Publication date
- 3 March 2026
- Language
- EN