CloudBreaker: Breaking the cloud covers of Sentinel-2 images using multi-stage trained conditional flow matching on Sentinel-1

Read full text
Authors: Saleh Sakib Ahmed, Sara Nowreen, M. Safiur Rahman
Cited by: 1
References: 19

Abstract

Cloud cover and nighttime conditions create significant blind spots in satellite remote sensing, frequently severing the temporal continuity of critical multi-spectral imagery. While Sentinel-1 Synthetic Aperture Radar (SAR) is immune to these atmospheric factors, it lacks the intuitive interpretability and spectral richness of optical data. Existing multi-modal SAR-optical fusion methods often prove inefficient in completely overcast scenarios. Furthermore, since Sentinel-1 and Sentinel-2 operate as distinct satellite missions with independent orbital tracks, these methods are severely constrained by the inevitable temporal misalignment between acquisitions. To bridge these gaps, this paper introduces CloudBreaker, a novel generative framework designed to synthesize high-fidelity Sentinel-2 imagery directly from single-modal Sentinel-1 inputs, effectively bypassing the requirement for concurrent optical data. Unlike existing SAR-to-optical translation approaches that are often limited to RGB synthesis, CloudBreaker generates comprehensive multi-spectral data, enabling the accurate derivation of essential vegetation and water indices (NDVI, NDWI). The methodology leverages a novel multi-stage training strategy based on conditional latent flow matching and introduces cosine scheduling—a technique under-utilized in this domain—to enhance convergence stability. Quantitatively, CloudBreaker achieves a Fréchet Inception Distance (FID) of 0.7432 and Structural Similarity (SSIM) scores exceeding 0.6 for derived indices. Qualitatively, the framework demonstrates exceptional utility in disaster response: by penetrating dense storm clouds and volcanic ash, CloudBreaker retrieves unobstructed optical visualizations and biophysical indices of active catastrophe fronts, including the Amazon wildfires and Hurricane Harvey. These results establish CloudBreaker as a vital tool for all-weather Earth observation where standard optical monitoring is rendered blind.

Fields of Study & Subjects

Remote-Sensing Image Classification Remote Sensing in Agriculture Synthetic Aperture Radar (SAR) Applications and Techniques

Publication details

Journal / source
Science of Remote Sensing
Publisher
Elsevier BV
Volume
13
Pages
100391–100391
Publication date
11 February 2026
Language
EN