Zero-Shot Clothing Sketch Retrieval and Feature Alignment Based on CLIP Contrastive Learning

Read full text Summarise with VIRAT
Authors: Sophie Bernard, Jean Dupont
Cited by: 0
References: 29

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

The rapid expansion of e-commerce platforms has necessitated the development of advanced information retrieval systems that allow users to search for products using intuitive modalities. Sketch-based image retrieval (SBIR) has emerged as a critical research area, bridging the domain gap between abstract, hand-drawn sketches and realistic product photographs. However, traditional SBIR methods often rely on closed-set assumptions, where the training and testing categories overlap completely. This presents a significant limitation in real-world scenarios where new fashion trends and clothing categories emerge constantly. This paper addresses the challenge of Zero-Shot SBIR (ZS-SBIR) within the clothing domain by leveraging the semantic power of Contrastive Language-Image Pre-training (CLIP). We propose a novel feature alignment framework that utilizes CLIP as a backbone to extractrobust semantic representations. By introducing a specializedprojection module and a semantic consistency regularization mechanism, we effectively align the disparate visual features of sketches and photos within a shared embedding space. Our approach mitigates the domain shift problem and preserves semantic integrity for unseen categories. Extensive experiments on standard benchmark datasets demonstrate that our method significantly outperforms state-of-the-art approaches in zero-shot retrieval tasks. The results validate the efficacy of contrastive learning in harmonizing cross-modal features and establish a new baseline for sketch-based clothing retrieval.

Fields of Study & Subjects

Advanced Image and Video Retrieval Techniques Image Retrieval and Classification Techniques 3D Shape Modeling and Analysis

Publication details

Journal / source
American Journal of Artificial Intelligence and Neural Networks
Volume
7
Issue
1
Pages
95–107
Publication date
28 February 2026
Language
EN