Engineering Implementation and Experimental Research of Video Structured Tag Generation System Based on Multimodal Information Fusion

Read full text
Authors: Jiechenyang Ye
Cited by: 0

Abstract

With the rapid development of short video platforms and User Generated Content (UGC), video data has accounted for an increasing proportion in internet information dissemination. Automatically extracting computable, retrievable, and interpretable structured semantic tags from massive unstructured videos has become a key technical issue in content recommendation, information retrieval, and content moderation systems. This paper proposes and implements an engineering-reproducible multimodal structured tag generation system for videos. Adopting a modular multimodal fusion architecture, the system extracts semantic information from three modalities—visual, speech, and on-screen text. Through unified structured representation and multimodal Prompt design, multi-source information is input into a large language model for joint reasoning, ultimately generating JSON-format output including topic hierarchy, multi-tag attributes, and confidence estimation. Experimental results show that the multimodal fusion method significantly outperforms single-modal schemes in topic classification and attribute recognition tasks. Moreover, the system can stably output structured JSON results, demonstrating high engineering usability. This paper details the engineering implementation experience and key technical trade-offs of the system under the Windows environment, providing a reference for subsequent research and practical deployment.

Fields of Study & Subjects

Multimodal Machine Learning Applications Video Analysis and Summarization Topic Modeling

Publication details

Journal / source
Advances in Economics Management and Political Sciences
Volume
252
Issue
1
Pages
233–243
Publication date
20 January 2026