Target-Level SAR-to-Optical Image Translation Driven by Semantic Segmentation

View at publisher
Authors: Huihui Li, Siyuan Liu, Zhou Zhou Liu, Hang Liu, Dawei Guo, Kun Liu
Cited by: 2
References: 40

Abstract

Synthetic Aperture Radar (SAR) is widely used in military and civilian applications due to its all-weather, day-and-night imaging capability. However, interpreting SAR images is challenging for both experts and non-experts. Inspired by deep learning-based style transfer, researchers have employed Generative Adversarial Networks (GANs) to convert SAR images into more intuitive optical ones. Yet, current loss functions and evaluation metrics focus mainly on pixel-level differences, overlooking the structural coherence required for target recognition and downstream tasks. To address this, we propose a semantic segmentation-driven framework for target-level SAR-to-optical image translation. Compatible with various supervised models, it incorporates segmentation loss and uses SAR segmentation maps as additional inputs to preserve target structure. Experiments on custom datasets, built from Sentinel 1-2 imagery with road binary segmentation labels, as well as public datasets, confirm the method's effectiveness across different base translation models. The source code and the datasets used will be published at the following URLhttps://github.com/NWPU-LHH/SOIT-Seg-Driven.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Domain Adaptation and Few-Shot Learning Advanced SAR Imaging Techniques

Publication details

Journal / source
IEEE Transactions on Aerospace and Electronic Systems
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
62
Pages
4143–4155
Publication date
1 January 2026