Trust Management Based on Attention-Weighted Federated Deep Reinforcement Learning for Underwater Acoustic Sensor Networks

Underwater acoustic sensor networks (UASNs) are extensively utilized in various sectors, including aquaculture, naval operations, and oceanic disaster alert systems. The protection of UASNs, with a specific focus on internal threats, has become an increasing priority. Attacks originating from within the network, involving compromised legitimate nodes, can be more harmful and covert compared to external threats, such as communication interception, data decryption, and identity impersonation. Trust models, which serve as mechanisms for detecting internal threats through interaction data, have proven effective in enhancing UASN security. However, traditional trust models often face scalability issues, particularly in environments characterized by mobile underwater devices, diverse network conditions, and evolving attack strategies. To address these challenges, this work presents a novel trust management scheme based on attention-weighted federated deep reinforcement learning (AFRTM). The AFRTM overcomes the limitations of existing approaches by first improving the evidence quantification methods-encompassing both environmental and behavioral evidence-to better adapt to the uncertainty of underwater scenarios. Subsequently, the acquired trust evidence is input into the respective deep reinforcement learning (DRL)-driven local trust framework to achieve trust estimation and model development. Finally, the model's parameters are periodically aggregated and updated using an attention-weighted federated learning method, ensuring adaptability to changing conditions. The experimental findings demonstrate that the suggested approach delivers commendable outcomes in enhancing trust estimation precision and energy efficiency, and further providing a robust solution to the security challenges faced by UASNs.