Cross-Modal Transformer Fusion for UAV-Ground Integrated Road Surface Anomaly Detection and Severity Quantification

View at publisher
Authors: Murat Bakırcı
Cited by: 0
References: 10

Abstract

Growing demands on transportation infrastructure have increased the need for automated and reliable solutions for detecting and assessing road surface defects. This work introduces an AI-driven multimodal framework that integrates unmanned aerial vehicle (UAV) imagery with ground-level visual data to support accurate defect detection and quantitative severity estimation. The proposed architecture combines an enhanced YOLOv8 backbone with a Cross-Modal Fusion Transformer (CMFT), which enables effective alignment of aerial and ground-view features through attention-based spatial reasoning. In addition, a dedicated severity estimation head refines localized representations to categorize surface damage into minor, moderate, and severe levels. Experimental evaluation on a custom multimodal dataset shows that the proposed method consistently outperforms unimodal baselines in terms of detection accuracy and robustness.

Fields of Study & Subjects

Infrastructure Maintenance and Monitoring Industrial Vision Systems and Defect Detection Advanced Neural Network Applications

Publication details

Journal / source
International Informatics and Software Engineering Conference (IISEC)
Pages
98–103
Publication date
5 February 2026
Language
EN