M2UNet: A Segmentation-Guided GAN with Attention-Enhanced U2-Net for Face Unmasking

Read full text
Authors: Mohamed Mahmoud, Mostafa Farouk Senussi, Mahmoud I. Abdalla, Mahmoud SalahEldin Kasem, Hyun-Soo Kang
Cited by: 1
References: 40

Abstract

Face unmasking is a critical task in image restoration, as masks conceal essential facial features like the mouth, nose, and chin. Current inpainting methods often struggle with structural fidelity when handling large-area occlusions, leading to blurred or inconsistent results. To address this gap, we propose the Masked-to-Unmasked Network (M2UNet), a segmentation-guided generative framework. M2UNet leverages a segmentation-derived mask prior to accurately localize occluded regions and employs a multi-scale, attention-enhanced generator to restore fine-grained facial textures. The framework focuses on producing visually and semantically plausible reconstructions that preserve the structural logic of the face. Evaluated on a synthetic masked-face dataset derived from CelebA, M2UNet achieves state-of-the-art performance with a PSNR of 31.3375 dB and an SSIM of 0.9576. These results significantly outperform recent inpainting methods while maintaining high computational efficiency.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Face recognition and analysis Facial Nerve Paralysis Treatment and Research

Publication details

Journal / source
Mathematics
Publisher
MDPI AG
Volume
14
Issue
3
Pages
477–477
Publication date
29 January 2026
Language
EN