Content style decoupling for multi style image generation using latent diffusion architecture

Read full text
Authors: Kaiyan Chu, Yu Shang, Lingrui Zhang, Haiyu Yuan
Cited by: 0
References: 47

Abstract

Existing multi-style image generation methods face critical challenges: insufficient content-style decoupling, high computational costs for high-resolution generation, and structural distortion during style transfer. To address these, we propose the Dual-Conditional Lightweight Style Diffusion Model (DCLSDM), a novel approach enhancing content-style decoupling via a dual-conditional control mechanism. This mechanism independently manages content structure and style expression, enabling better control in style transfer. Experimental results on WikiArt and Summer2Winter Yosemite datasets show DCLSDM outperforms comparative models in SSIM, LPIPS, and FID, with significant improvements in inference time, memory usage, and parameter scale-making it suitable for resource-constrained scenarios. It offers an efficient, controllable solution for multi-style image generation, with potential in content creation and digital art production.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Digital Media Forensic Detection Advanced Neural Network Applications

Publication details

Journal / source
Scientific Reports
Volume
16
Issue
1
Pages
6642–6642
Publication date
29 January 2026
Language
EN