Dynamic Resource Allocation in Maritime Unmanned Networks: A Hybrid Approach of Three-Sided Matching and Reinforcement Learning

With the integrated development of global marine exploitation and 6G technology, building an all-domain marine wireless network has become crucial for supporting marine activities. However, the unique communication environment, varying collaboration of heterogeneous devices, and dynamic network changes pose technical bottlenecks for balancing real-time and efficient resource competition. To overcome those challenges, this paper proposes a novel integrated marine wireless network with multi-type unmanned device clusters across space-surface-submarine media. To address heterogeneous resource allocation, we consider channel capacity and device connection, modeling it as a three-sided matching framework with size constraints and cyclic preferences (TMSC). Building on this, we propose the satellite-prioritized restricted double-TMSC (SPR-DT) algorithm to solve optimal matching in quasi-static networks, aiming to maximize total backhaul revenue. To handle rapid dynamic network changes, we initialize the proximal policy optimization (PPO) with the stable solution of SPR-DT, thus addressing the challenge of acquiring real training data while accelerating algorithm convergence. Then, we propose a PPO-assisted multi-slot matching algorithm to enhance solution efficiency in large-scale dynamic scenarios. The simulation results show that the proposed algorithm achieves an optimal effect of 94.6% in quasistatic scenarios, with a complexity reduced to 3.2%. In dynamic scenarios, the results are 87.2% and 28.7%, respectively.