CC-MBS: A Missing-Modality-Robust Multimodal Sample Selection Strategy for UAV Swarms
Abstract
In resource-constrained UAV swarm systems, multimodal sensory data are often affected by complex environmental factors, resulting in modality missing, signal degradation, and asynchrony, which significantly reduce the reliability of multimodal learning and incremental model updates. To address this issue, we propose a Compensatory Collaboration Modality-Balanced Sample Selection framework (CC-MBS), which improves robustness through modality quality modeling and cross-UAV collaborative compensation. Specifically, a modality confidence vector is introduced to quantify modality reliability from missing rate, degradation, and asynchrony. A lightweight collaboration mechanism is designed to exchange low-dimensional confidence information instead of high-dimensional features or model parameters. Based on the compensated confidence, a modality-aware sample selection strategy is further developed to prioritize high-value samples under limited memory. Experimental results on multi-UAV scenarios show that CC-MBS outperforms representation-based methods such as ShaSpec and its parameter aggregation variants (AVG, PFM, POW) in modality compensation under missing conditions. In addition, it achieves stronger robustness than MBS and training-dynamics-based methods such as EL2N and GraNd in sample selection. These results demonstrate that CC-MBS effectively improves robustness and data efficiency for multimodal incremental learning under incomplete modalities.
Fields of Study & Subjects
UAV Applications and Optimization
Video Surveillance and Tracking Methods
Advanced Neural Network Applications
Publication details
- Journal / source
- Preprints.org
- Publisher
- MDPI AG
- Publication date
- 3 June 2026
- Document type
- Preprint