A Multiobjective Evolutionary Algorithm Based on Bipopulation With Uniform Sampling for Neural Architecture Search

Read full text
Authors: Yu Xue, Pengcheng Jiang, Chenchen Zhu, Yong Zhang, Ran Cheng, Kaizhou Gao, Dunwei Gong
Cited by: 0

Abstract

Neural architecture search (NAS) automates neural network design, improving efficiency over manual approaches. However, efficiently discovering high-performance neural network architectures that simultaneously optimize multiple objectives remains a significant challenge in NAS. Existing methods often suffer from limited population diversity and inadequate exploration of the search space, particularly in regions with extreme complexity values. To address these challenges, we propose a multiobjective evolutionary algorithm (MOEA)-BUS, an innovative MOEA based on bipopulation with uniform sampling for NAS, aimed at simultaneously optimizing both accuracy and network complexity. In MOEA-BUS, a novel uniform sampling method is proposed to initialize the population, ensuring that architectures are distributed uniformly across the objective space. Furthermore, to enhance exploration, we deploy a bipopulation framework where two populations evolve synergistically, facilitating comprehensive search space coverage. Experiments on CIFAR-10 and ImageNet demonstrate MOEA-BUS's superiority, achieving top-one accuracies of 98.39% on CIFAR-10, and 80.03% on ImageNet. Notably, it achieves 78.28% accuracy on ImageNet with only 446 M MAdds. Ablation studies confirm that both uniform sampling and bipopulation mechanisms enhance population diversity and performance. In addition, in terms of Kendall's tau coefficient, the SVM achieves an improvement of at least 0.035 compared to the other three commonly used machine learning models, and uniform sampling provided an enhancement of approximately 0.07.

Fields of Study & Subjects

Advanced Multi-Objective Optimization Algorithms Evolutionary Algorithms and Applications Advanced Neural Network Applications

Publication details

Journal / source
IEEE Transactions on Neural Networks and Learning Systems
Volume
37
Issue
9
Pages
4121–4135
Publication date
10 February 2026
Language
EN