Active Asymmetric Multi-Agent Multimodal Learning under Uncertainty

Read full text
Authors: Rui Liu, Pratap Tokekar, Ming C. Lin
Cited by: 0

Abstract

Multi-agent systems are increasingly equipped with heterogeneous multimodal sensors, enabling richer perception but introducing modality-specific and agent-dependent uncertainty. Existing multi-agent collaboration frameworks typically reason at the agent level, assume homogeneous sensing, and handle uncertainty implicitly, limiting robustness under sensor corruption. We propose Active Asymmetric Multi-Agent Multimodal Learning under Uncertainty (A2MAML), a principled approach for uncertainty-aware, modality-level collaboration. A2MAML models each modality-specific feature as a stochastic estimate with uncertainty prediction, actively selects reliable agent-modality pairs, and aggregates information via Bayesian inverse-variance weighting. This formulation enables fine-grained, modality-level fusion, supports asymmetric modality availability, and provides a principled mechanism to suppress corrupted or noisy modalities. Extensive experiments on connected autonomous driving scenarios for collaborative accident detection demonstrate that A2MAML consistently outperforms both single-agent and collaborative baselines, achieving up to 18.7% higher accident detection rate.

Fields of Study & Subjects

Autonomous Vehicle Technology and Safety Multimodal Machine Learning Applications Distributed Control Multi-Agent Systems

Publication details

Journal / source
arXiv (Cornell University)
Publication date
4 February 2026
Document type
Preprint