A Modular Framework with an Adaptive Momentum-based Evolutionary Strategy for Physics-Informed Neural Networks

View at publisher Summarise with VIRAT
Authors: Fanke Chen, Fengrong Zhou, Yinghui Pan, Yifan Lu, Chengwen Luo
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Physics-Informed Neural Networks have emerged as a powerful tool for solving partial differential equations, but their success is often hindered by complex, high-dimensional loss landscapes. While evolutionary strategies offer a promising gradient-free alternative, standard methods struggle with the scalability required for modern deep learning models. In this article, we propose a Modular and Extensible Evolutionary-Strategy-based framework for Physics-Informed Neural Networks (MEES-PINN) that integrates problem-specific physics with evolutionary optimization. The framework is designed in a modular and flexible manner, enabling a seamless combination of different physical problems, neural architectures, and evolutionary algorithms within a single pipeline. It also provides a foundation to analyze PINN optimization through a “dual matching” requirement — aligning the network capacity with problem complexity and optimizer power with the network scale. To address the limitations of existing optimizers within this framework, we propose an Adaptive Momentum Natural Evolution Strategy (AMNES), which enhances xNES with an Adam-like scheme incorporating exponential moving averages (EMA) of first and second moments for the robust, scale-adaptive update. Extensive experiments across diverse PDE benchmarks and network architectures reveal a key insight: while powerful baselines like CMA-ES excel on smaller networks, their performance degrades significantly as the network capacity increases. In contrast, AMNES within MEES-PINN demonstrates superior scalability, consistently achieving better physically accurate solutions, as confirmed by quantitative metrics and qualitative visualization.

Fields of Study & Subjects

Model Reduction and Neural Networks Metaheuristic Optimization Algorithms Research Neural Networks and Applications

Publication details

Journal / source
IEEE Transactions on Evolutionary Computation
Pages
1–1
Publication date
1 January 2026
Language
EN