Mathematical modeling and AI-based AVOA-RSA algorithm for secure data communication

The increasing sophistication of cyber threats necessitates the development of more robust cryptographic systems. This paper introduces African Vulture Optimization- Enhanced RSA (AVO-RSA), a novel hybrid cryptosystem that integrates the African Vulture Optimization Algorithm (AVOA) with the traditional RSA algorithm to enhance security in data communication. AVO-RSA optimizes prime number selection and key generation using bio-inspired heuristics, making it more resistant to brute-force and factorization attacks. The proposed algorithm dynamically adjusts key parameters based on communication patterns, ensuring adaptive security. Experimental results demonstrate that AVO-RSA improves key strength while maintaining computational efficiency. This work contributes to the field of bio-inspired cryptography by introducing a nature-based optimization technique to strengthen asymmetric encryption. By optimizing prime selection using mathematical modelling and AI-driven search patterns, the proposed system significantly strengthens the resilience of RSA against modern cryptographic attacks. Experimental results demonstrate improvements in key unpredictability, encryption efficiency, and overall security, making it highly suitable for secure data communication.