Text–Vision-Guided Latent Prediction for High-Fidelity Blind Face Restoration

View at publisher
Authors: Juan Cai, Lianxin Xie, Wen Xue, Si Wu
Cited by: 0
References: 21

Abstract

Blind face restoration (BFR) aims to recover high-quality (HQ) facial images from degraded inputs with unknown distortions, while preserving identity consistency. Existing methods either rely solely on visual priors or incorporate generic textual cues, struggle with noise sensitivity or insufficient semantic guidance. In this paper, we present a vision-language guided BFR framework that consists of three key components: (1) a Facial Key Attribute Estimation module that leverages structured text to compactly describe facial attributes; (2) a Dual-modal Based Latent Prediction module built on a shared-attention Transformer, which fuses visual and textual embeddings to predict dictionary elements representing the target face; (3) a Text-based Adaptive Feature Filter that dynamically suppresses noise in skip-connected features by aligning them with textual semantics, enhancing the generator’s ability to leverage multi-scale spatial information. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches on multiple benchmarks, particularly under severe degradation.

Fields of Study & Subjects

Advanced Image Processing Techniques Generative Adversarial Networks and Image Synthesis Face recognition and analysis

Publication details

Journal / source
IEEE Multimedia
Volume
33
Issue
2
Pages
142–154
Publication date
27 January 2026