DVLTA-VQA: Decoupled Vision-Language Modeling With Text-Guided Adaptation for Blind Video Quality Assessment

Read full text
Authors: Li Yu, Situo Wang, Wei Zhou, Moncef Gabbouj
Cited by: 4
References: 48

Abstract

Inspired by the dual-stream (dorsal and ventral streams) theory of the human visual system (HVS), recent Video Quality Assessment (VQA) methods have integrated Contrastive Language-Image Pretraining (CLIP) to enhance semantic understanding. However, as CLIP is originally designed for images, it lacks the ability to adequately capture the temporal dynamics and motion perception (dorsal stream) inherent in videos. To address this limitation, we propose DVLTA-VQA (Decoupled Vision-Language Modeling with Text-Guided Adaptation), which decouples CLIP’s visual and textual components to better align with the NR-VQA pipeline. Specifically, we introduce a Video-Based Temporal CLIP module and a Temporal Context Module to explicitly model motion dynamics, effectively enhancing the dorsal stream representation. Complementing this, a Basic Visual Feature Extraction Module is employed to strengthen spatial detail analysis in the ventral stream. Furthermore, we propose a text-guided adaptive fusion strategy that leverages textual semantics to dynamically weight visual features, facilitating effective spatiotemporal integration. Extensive experiments on multiple public datasets demonstrate that the proposed method achieves state-of-the-art performance, significantly improving prediction accuracy and generalization capability.

Fields of Study & Subjects

Visual Attention and Saliency Detection Human Pose and Action Recognition Multimodal Machine Learning Applications

Publication details

Journal / source
IEEE Transactions on Circuits and Systems for Video Technology
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
36
Issue
5
Pages
6826–6837
Publication date
23 January 2026