Zero-Shot Clothing Sketch Retrieval and Feature Alignment Based on CLIP Contrastive Learning
Summary
No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.
Summarise with VIRAT Free to try with your Science Catalogs account.Abstract
The rapid expansion of e-commerce platforms has necessitated the development of advanced information retrieval systems that allow users to search for products using intuitive modalities. Sketch-based image retrieval (SBIR) has emerged as a critical research area, bridging the domain gap between abstract, hand-drawn sketches and realistic product photographs. However, traditional SBIR methods often rely on closed-set assumptions, where the training and testing categories overlap completely. This presents a significant limitation in real-world scenarios where new fashion trends and clothing categories emerge constantly. This paper addresses the challenge of Zero-Shot SBIR (ZS-SBIR) within the clothing domain by leveraging the semantic power of Contrastive Language-Image Pre-training (CLIP). We propose a novel feature alignment framework that utilizes CLIP as a backbone to extractrobust semantic representations. By introducing a specializedprojection module and a semantic consistency regularization mechanism, we effectively align the disparate visual features of sketches and photos within a shared embedding space. Our approach mitigates the domain shift problem and preserves semantic integrity for unseen categories. Extensive experiments on standard benchmark datasets demonstrate that our method significantly outperforms state-of-the-art approaches in zero-shot retrieval tasks. The results validate the efficacy of contrastive learning in harmonizing cross-modal features and establish a new baseline for sketch-based clothing retrieval.
Fields of Study & Subjects
Advanced Image and Video Retrieval Techniques
Image Retrieval and Classification Techniques
3D Shape Modeling and Analysis
Publication details
- Journal / source
- American Journal of Artificial Intelligence and Neural Networks
- Volume
- 7
- Issue
- 1
- Pages
- 95–107
- Publication date
- 28 February 2026
- Language
- EN