Target-Aware Fusion: A Diffusion Model for Infrared and Visible Image Integration to Enhance Object Detection

There are differences in imaging characteristics between infrared and visible light images: visible light images can provide rich texture and color information, but imaging is limited in harsh weather conditions. Infrared images are based on the target’s thermal radiation characteristics and have the ability to resist environmental interference but lack details and background information. Effectively integrating the two can significantly enhance scene understanding ability and improve environmental perception and target recognition performance in applications such as intelligent driving. However, existing fusion methods still face challenges, especially in complex scenes where it is difficult to balance the full preservation of target information with the complete presentation of background details, often resulting in difficulties in extracting differentiated features from different modalities. This article proposes a target detection method based on the visible light infrared fusion diffusion model. This method introduces the Stable Diffusion architecture and designs a target perception spatial fusion weight module that can adaptively generate a spatial fusion weight map based on modal differences. By implementing a multi-stage dynamic fusion strategy, the fusion ratio is automatically adjusted at different diffusion stages. A full-step multi-step prediction mechanism is adopted to improve fusion quality and stability. Compared with existing methods, the method proposed in this article has significant advantages. Experiments on multiple publicly available datasets have shown that this method outperforms existing mainstream methods in key metrics such as Peak Signal to Noise Ratio (PSNR), Mean Square Error (MSE), and ean Absolute Error (MAE) and also demonstrates good detection performance in downstream tasks for object detection.