Object-guided contrastive language-image pre-training for zero-shot target recognition
Abstract
Target recognition is critical for security systems, but traditional Visual-Language Models (VLMs) like CLIP suffer from limited training data semantics, poor background suppression, and inflexible multi-resolution features. To address these, we propose Object-Guide CLIP (OG-CLIP), integrating three core enhancements: Knowledge graph-driven data augmentation: A 5000-category military knowledge graph and 1M image-text pairs via multi-source acquisition and knowledge-infused prompts. Target-centered ROI module: Fuses SAM 2-generated masks with ViT features to focus on discriminative regions and suppress background noise. Adaptive MRL: Resolves traditional MRL's rigid granularity via 128D-1024D continuous features, dynamic dimension weighting, and cross-granularity semantic alignment. Experiments on 99 target categories (military aircraft, warships, civilian targets) show OG-CLIP achieves 84.28% mean Accuracy (mAcc), 11.36 percentage points higher than baseline CLIP. Ablation confirms contributions of each component, and OG-CLIP excels in complex scenarios. The proposed framework offers a scalable and adaptable vision-language modeling approach for military recognition, with future work focusing on dataset expansion and model lightweight optimization.
Fields of Study & Subjects
Multimodal Machine Learning Applications
Advanced Neural Network Applications
Domain Adaptation and Few-Shot Learning
Publication details
- Journal / source
- Scientific Reports
- Volume
- 16
- Issue
- 1
- Pages
- 6425–6425
- Publication date
- 28 January 2026
- Language
- EN