Driving Style Recognition Like an Expert Using Semantic Privileged Information From Large Language Models

View at publisher
Authors: Zhaokun Chen, Chaopeng Zhang, X.C. Li, Wenshuo Wang, Gentiane Venture, Junqiang Xi
Cited by: 1
References: 70

Abstract

Existing driving style recognition systems largely depend on low-level sensor-derived features for training, neglecting the rich semantic reasoning capability inherent to human experts. This discrepancy results in a fundamental misalignment between algorithmic classifications and expert judgments. To bridge this gap, we propose a novel framework that integrates Semantic Privileged Information (SPI) derived from large language models (LLMs) to align recognition outcomes with human-interpretable reasoning. First, we introduce DriBehavGPT, an interactive LLM-based module that generates natural-language descriptions of driving behaviors. These descriptions are then encoded into machine learning-compatible representations via text embedding and dimensionality reduction. Finally, we incorporate them as privileged information into Support Vector Machine Plus (SVM+) for training, enabling the model to approximate human-like interpretation patterns. Experiments across diverse real-world driving scenarios demonstrate that our SPI-enhanced framework consistently outperforms a wide range of baselines, achieving$F_{1}$-scores of 90.2% (car-following) and 91.0% (lane-changing). Importantly, SPI is exclusively used during training, while inference relies solely on sensor data, ensuring computational efficiency without sacrificing performance. These results highlight the pivotal role of semantic behavioral representations in improving recognition accuracy while advancing interpretable, human-centric driving systems.

Fields of Study & Subjects

Topic Modeling Authorship Attribution and Profiling Advanced Graph Neural Networks

Publication details

Journal / source
IEEE Transactions on Intelligent Transportation Systems
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
27
Issue
9
Pages
11357–11371
Publication date
18 May 2026