Optimizing Prompts With MLLM for Multimodal Product Style Recognition in Industry 5.0

View at publisher Summarise with VIRAT
Authors: Mengxue Li, Haojie Huang, Yan Hong, Ziqiang Cao, Jie Zhang, Song Guo
Cited by: 0
References: 40

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

The transition to Industry 5.0, supported by the high-bandwidth and low-latency capabilities of 6G networks, accelerates the demand for personalized products, making efficient and accurate product style recognition a critical task. However, traditional recognition models, which rely heavily on large-labeled datasets, struggle with generalization and efficiency in such data-rich environments. In contrast, multimodal large language models (MLLMs), such as Qwen-VL, offer new possibilities by integrating visual and textual inputs, requiring less annotated data and demonstrating strong generalization. Nevertheless, most existing MLLMs are general-purpose and lack optimized prompts tailored for domain-specific tasks, limiting their recognition performance. To address this, we propose a prompt optimization framework that combines genetic algorithms (GA) and chain of thought (CoT) reasoning. GA is used to iteratively refine the instruction component of prompts, while CoT encourages step-by-step reasoning, improving the model’s interpretability and recognition accuracy. Validated on a custom-built apparel dataset and the public FashionStyle14 dataset, our method enables Qwen-VL to achieve significant accuracy improvements of 8.7% and 19.6%, respectively, over the baseline. This study makes three contributions: a framework to adapt general MLLMs for fine-grained style recognition; a demonstration of 6G-enabled real-time artificial intelligence reasoning loops; and a high-quality, multidimensional style dataset for future research. This demonstrates the effectiveness and stability of the proposed framework in handling fine-grained style recognition tasks, contributing to the development of intelligent design systems for Industry 5.0.

Fields of Study & Subjects

Multimodal Machine Learning Applications Advanced Neural Network Applications Generative Adversarial Networks and Image Synthesis

Publication details

Journal / source
IEEE Transactions on Industrial Informatics
Volume
22
Issue
6
Pages
4765–4776
Publication date
25 March 2026
Language
EN