Training-Free Concept Disentanglement in Text-to-Image Generation via Detection-Guided Attention Control

Read full text
Authors: Fengkai Gao
Cited by: 0

Abstract

Large-scale Text-to-Image (T2I) diffusion models have achieved remarkable photorealism but frequently suffer from attribute leakage (also known as concept entanglement), where visual attributes such as color or texture bleed into unintended regions. Existing solutions often rely on costly fine-tuning or auxiliary adapters, limiting their flexibility. To address this, we propose a novel Training-Free Spatial-Gated Attention Control framework that enforces strict attribute disentanglement during the inference stage. Specifically, we leverage an open-vocabulary detector (OwlViT) to extract zero-shot layout priors and introduce a Spatial-Gated Boosting mechanism to dynamically intervene in Cross-Attention layers. This mechanism amplifies target signals within designated regions while suppressing background noise, ensuring precise concept localization. Quantitative evaluation demonstrates that our method achieves a 11% relative improvement in CLIP Score compared to traditional inpainting baselines, indicating superior semantic consistency. Furthermore, our approach exhibits an emergent "layout correction" capability, where it automatically refines unnatural bounding box constraints to align with physical plausibility (e.g., repositioning accessories), offering a robust and efficient solution for controllable generation. Furthermore, our approach exhibits an emergent "layout correction" capability. Our code and data are publicly available at https://github.com/QCYTSN/Training-Free-Concept-Disentanglement-in-T2I-Generation-via-Detection-Guided-Attention-Control.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Multimodal Machine Learning Applications Advanced Neural Network Applications

Publication details

Publication date
17 February 2026
Language
EN
Document type
Preprint