GA-Adam: A Hybrid Optimization Framework Balancing Exploration and Exploitation
Abstract
This paper presents a hybrid optimization method combining the Genetic Algorithm (GA) and the Adaptive Moment Estimation (Adam) optimizer to balance global exploration and local exploitation.GA performs robust global search but converges slowly near local optima, while Adam achieves fast local convergence yet struggles with poor local minima.The proposed two-phase Genetic Algorithm-Adaptive Moment Estimation (GA-Adam) approach first evolves candidate solutions using GA, then applies Adam for gradient-based refinement.Experiments on three tasksthe multi-modal Rastrigin function, the CartPole reinforcement learning environment, and Support Vector Machine (SVM) hyperparameter tuning on a Public Benchmark Dataset -show significant gains over standalone GA and Adam.On the Rastrigin function, the objective value improved from 1.3 × 10⁻⁵ (GA) to nearly zero GA-Adam; in CartPole, the average reward increased from approximately 140 to approximately 490; and in SVM tuning, cross-validation accuracy reached 98.89%, demonstrating both improved convergence efficiency and more stable performance across runs.These results confirm the effectiveness of GA-Adam in achieving faster convergence and higher accuracy with moderate computational cost, making it suitable for hyperparameter tuning, control policy optimization, and multi-modal function optimization.
Fields of Study & Subjects
Formal Methods in Verification
Constraint Satisfaction and Optimization
Advanced Optimization Algorithms Research
Publication details
- Journal / source
- International journal of intelligent engineering and systems
- Publisher
- The Intelligent Networks and Systems Society
- Volume
- 19
- Issue
- 2
- Pages
- 267–281
- Publication date
- 20 January 2026