mIT-CMCA: a cross-modal category alignment framework for robust maize disease identification

Read full text
Authors: Feilong Tang, Rosalyn R. Porle, Hoe Tung Yew, Farrah Wong
Cited by: 0
References: 49

Abstract

Accurate identification of maize diseases is crucial for safeguarding global food security. Traditional image-based methods often struggle with lighting variations, occlusions, and noise, limiting their robustness and generalisation. Multimodal approaches that integrate visual and textual information have shown promise. However, these methods frequently require manually curated textual descriptions for each image, increasing data collection costs and limiting scalability and practical implementation. To address these limitations, we proposed a maize image-text framework with Cross-Modal Category Alignment (mIT-CMCA). This approach enforces category-level alignment between image and text modalities, enabling more accurate and interpretable cross-modal mapping. First, we construct cross-modal representations by aligning image and text modalities at the category level within a shared embedding space. Second, inspired by contrastive learning, we introduce a Cross-Modal Category Alignment (CMCA) loss based on category-level textual descriptions, reducing annotation complexity. Finally, we present an Efficient Channel-Spatial Hybrid Attention (CSHA) module that preserves inter-class boundaries while incurring minimal computational overhead, thereby enhancing feature discriminability under complex conditions. Experimental results on the maize subset of the PlantVillage dataset (MPVD) show that mIT-CMCA achieves 99.48% accuracy, 99.28% precision, 99.54% recall, and 99.41% F1-score. These results represent improvements of 0.24%, 0.13%, 0.17%, and 0.15% over the strongest vision-only baseline, MaxViT_tiny. On the self-built Maize Leaf-Field dataset (MLFD), the model achieves 93.67% accuracy, 93.76% precision, 93.67% recall, and 93.71% F1-score. It uses only 8.27 million parameters, which is 71.6% fewer than MaxViT_tiny. Its model size is 32.13 MB, which is 72.3% smaller. The proposed method also outperforms comparative models in robustness experiments under artificially added perturbations. These results demonstrate that mIT-CMCA achieves a favorable balance between accuracy and efficiency, making it suitable for practical agricultural deployment.

Fields of Study & Subjects

Spectroscopy and Chemometric Analyses Smart Agriculture and AI

Publication details

Journal / source
Scientific Reports
Publisher
Springer Science and Business Media LLC
Volume
16
Issue
1
Publication date
21 April 2026
Language
EN