HCV-CVAE: A hierarchical convolutional variational transformer for thin cloud removal in remote sensing imagery

Read full text
Authors: Yan Zhang, Feng Han, Juwei Xiang, Jiwu Guan, Song Wang
Cited by: 1
References: 12

Abstract

To address the challenge faced by existing thin-cloud removal methods in balancing global structure reconstruction and local texture restoration under complex cloud conditions, this paper proposes a remote sensing image de-clouding approach based on a Hierarchical Convolutional Variational Vision Transformer (HCV-CVAE). Built upon the conventional CVAE framework, the proposed model introduces an HCV-ViT encoder that integrates the strengths of convolutional networks and Transformers to enhance local texture representation while capturing global semantic dependencies. Furthermore, strategies such as KL-divergence annealing, cross-dimensional weighted mutual information loss, and test-time augmentation are incorporated to improve the stability of the latent space and the robustness of the generation process. The proposed approach exhibits superior performance over existing algorithms on the RICE2 and T-Cloud datasets, with the highest PSNR and SSIM reaching 40.93 dB and 0.9872, respectively. The HCV-CVAE effectively restores fine details and spectral characteristics beneath clouds while maintaining global structural consistency, exhibiting significant advantages in both visual quality and quantitative metrics.All implementation code and pretrained models are publicly available at:https://github.com/Kyperio/HCV-CVAE.

Fields of Study & Subjects

Remote-Sensing Image Classification Advanced Image Fusion Techniques Synthetic Aperture Radar (SAR) Applications and Techniques

Publication details

Journal / source
Science of Remote Sensing
Publisher
Elsevier BV
Volume
13
Pages
100380–100380
Publication date
24 January 2026
Language
EN