A Multimodal Virtual Psychiatrist Interviewer and Mental Health Screener

Read full text
Authors: Yeresime Suresh
Cited by: 0

Abstract

The global increase in mental-health conditions such as anxiety, depression, and stress highlights the need for accessible and timely psychological evaluation. Conventional evaluation remains limited due to clinician shortages and the stigma associated with seeking help. This work presents a multimodal Virtual Psychiatrist Interviewer designed to facilitate adaptive and scalable early-stage mental-health screening. The proposed framework integrates DistilBERT for linguistic interpretation, a convolutional audio-emotion model to analyze vocal cues, and V2Face-based facial-affect recognition for visual understanding. An attention-driven fusion mechanism combines text, acoustic, and facial embeddings to capture complementary behavioral signals and produce robust preliminary assessments. The system is trained and evaluated on a curated mental health text dataset, the RAVDESS emotional speech corpus, and publicly available facial expression datasets. Experimental results demonstrate competitive performance on anxiety, depression, and stress detection tasks, while ablation studies confirm the contribution of each modality. The findings indicate the potential of the proposed system for real-time AI-assisted mental-health support

Fields of Study & Subjects

Emotion and Mood Recognition Mental Health via Writing Digital Mental Health Interventions

Publication details

Journal / source
International Journal for Research in Applied Science and Engineering Technology
Volume
14
Issue
1
Pages
786–794
Publication date
16 January 2026