Recurrent alignment with dynamic query attention transformer framework for rainy video restoration

View at publisher
Authors: Javed Aymat Husen Shaikh, Shailendrakumar Mahadeo Mukane, Santosh Nagnath Randive
Cited by: 0
References: 63

Abstract

High-quality video is a prerequisite for dependable analysis in surveillance, traffic monitoring, and autonomous navigation. Rain, fog, and haze mask scene structure and reduce detection, tracking, and recognition accuracy. These effects appear in both day and night footage, yet many prior methods are built for one setting and transfer poorly. We address this gap with a single framework that restores multi-weather videos across day and night. It has two parts: (i) the Dynamic Query Attention Transformer (DQAT) block, which uses dynamic convolutions to form adaptive queries and focus attention on informative regions; and (ii) the Temporal Alignment Block (TAB), which enforces flow-free temporal consistency using self-calibrated and deformable convolutions for alignment. Together, they recover fine detail while keeping frames stable under changing weather and illumination. Experiments on day and night multi-weather datasets show consistent gains over recent methods, with a compact design for practical deployment.

Fields of Study & Subjects

Image Enhancement Techniques Advanced Image Processing Techniques Generative Adversarial Networks and Image Synthesis

Publication details

Journal / source
The Imaging Science Journal
Volume
74
Issue
5
Pages
516–526
Publication date
3 February 2026
Language
EN