Multimodal generative AI for automated pavement condition assessment: Benchmarking model performance

Read full text
Authors: Chang Xu, Lei Shu, Anh Dao, Yue Cui
Cited by: 1
References: 61

Abstract

Accurate and efficient pavement condition assessment is essential for maintaining roadway safety and optimizing maintenance investments. However, conventional assessment methods such as manual visual inspections and specialized sensing equipment are often time-consuming, expensive, and difficult to scale across large networks. Recent advancements in generative artificial intelligence (GAI) have introduced new opportunities for automating visual interpretation tasks using street-level imagery. This study evaluates the performance of seven multimodal large language models (MLLMs) for road surface condition assessment, including three proprietary models (Gemini 2.5 Pro, OpenAI o1, and GPT-4o) and four open-source models (Gemma 3, Llama 3.2, LLaVA v1.6 Mistral, and LLaVA v1.6 Vicuna). The models were tested across four task categories relevant to pavement management: distress and feature identification, spatial pattern recognition, severity evaluation, and maintenance interval estimation. Model performance was assessed across five dimensions: response rate, response correctness, consistency, multimodal errors, and overall computational intensity and cost. Results indicate that MLLMs can interpret street-level imagery and generate task-relevant outputs in a cost-effective manner. Among the evaluated models, we recommend GPT-4o as the preferred option, as it balances responsiveness, accuracy, and computational cost.

Fields of Study & Subjects

Infrastructure Maintenance and Monitoring Advanced Neural Network Applications Asphalt Pavement Performance Evaluation

Publication details

Journal / source
PLoS ONE
Publisher
Public Library of Science (PLoS)
Volume
21
Issue
2
Pages
e0340380–e0340380
Publication date
12 February 2026
Language
EN