Multi-modal depth modeling technology for behavior prediction of unmanned vehicles in complex traffic scenes

View at publisher Summarise with VIRAT
Authors: Xiaoji Zhou, Jian Zhang, Tao Ni, ChengJin Xiao, Deng Pan
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

The existing single-mode or simple fusion methods are difficult to deal with "long tail scenes" such as construction diversion and traffic police gestures, and lack of effective modeling of multi-agent dynamic interaction intentions. In this paper, a multi-modal depth modeling framework of Cross-Modal Dynamic Intent Graph (MDIG) is proposed, and a technical breakthrough is achieved through three innovations: A hierarchical attention fusion mechanism is designed, in which Local Self-Attention (LSA) is used to align the heterogeneous characteristics of agents, and Cross-Modal Attention (CMA) is used to capture the interaction between agents. The dynamic Intent Query Pair (IQP) is introduced, which combines the static query of historical pattern learning with the dynamic query of real-time scene awareness to cover the multimodal uncertainty of trajectory. Implicit Scene Alignment (ISA) self-supervised learning is adopted to constrain the consistent distribution of multimodal features in the potential space, and improve the generalization ability of the model to unlabeled extreme scenes. Experiments on Argoverse 2 and nuScenes data sets show that CMDIG is superior to the existing baseline methods in minADE, minFDE, Miss Rate and brier-minFDE, especially in the off-distribution test with emergency vehicles, which verifies its robustness and accuracy in complex interactive environment.

Fields of Study & Subjects

Autonomous Vehicle Technology and Safety Traffic and Road Safety Advanced Vision and Imaging

Publication details

Journal / source
IET conference proceedings.
Volume
2025
Issue
47
Pages
1007–1013
Publication date
1 March 2026
Language
EN