MULTIMODAL SENTIMENT ANALYSIS USING VISION-LANGUAGE TRANSFORMERS (VLTS) FOR SOCIAL MEDIA CONTENT

Read full text Summarise with VIRAT
Authors: Prakash Singh, Dr. Neha Gupta
Cited by: 0
References: 25

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

The technique of multimodal sentiment analysis enables researchers to examine human emotions through its capability to process data from three different sources which include text and audio as well as visual signals. The research intro- duces a new multimodal framework which uses transformer technology to build its system via vision-language models and large language models that enable the system to analyze multiple modal links while maintaining its ability to under- stand contextual information. The model uses cross-modal attention together with feature fusion methods to increase the accuracy of sentiment predictions. Researchers used CMU-MOSEI dataset for testing purposes because it contains over 23000 annotated video segments from more than 1000 speakers who presented their opinions about different topics with sentiment intensity labels that ranged from 3 to +3. The experimental results show that the proposed model out- performs both traditional unimodal methods and early fusion methods because it achieves better accuracy and F1-score results. The system now uses explainable AI techniques to enhance model interpretability which enables its applications in real-world scenarios involving social media analytics and human-computer interaction as well as affective computing.

Fields of Study & Subjects

Sentiment Analysis and Opinion Mining Emotion and Mood Recognition Multimodal Machine Learning Applications

Publication details

Volume
10
Issue
3
Pages
268–280
Publication date
22 March 2026
Language
EN