Safety-Guaranteed Energy Management in Networked Multienergy Microgrids: A Multi-Actor Single-Critic Deep Reinforcement Learning Approach

View at publisher
Authors: Hao Yang, H. Tian, Fanghong Guo, Ruilong Deng
Cited by: 5
References: 28

Abstract

Distributed energy systems are shifting from stand-alone microgrids to networked multienergy microgrids (N-MEMGs), where energy management must handle multienergy coupling, renewable uncertainty, and strict device/network safety under distributed operation. A safety-guaranteed framework that couples a multi-actor single-critic multiagent deep reinforcement learning method with randomized ensembled double$Q$-learning (REDQ) and a model-based safety layer is proposed. Actors run locally at nodes for decentralized operation; a centralized REDQ-based critic module reduces$Q$-value overestimation and reliably guides policy updates; and the safety layer analytically enforces device, power balance, and multitimescale constraints, explicitly capturing inertia-induced effects along hydrogen device chains. On a five-node N-MEMG, the proposed method coordinates energy trading, hydrogen storage, and peak shaving, achieves zero observed safety violations over 12 000 evaluation steps, and outperforms mainstream baselines (multi-agent twin delayed deep deterministic policy gradient (MATD3), multiagent deep deterministic policy gradient, and multiagent soft actor critic) with an average daily adaptive normalized score of 98% across test days. The results point to a practical route to safe and scalable energy management in N-MEMGs.

Fields of Study & Subjects

Microgrid Control and Optimization Integrated Energy Systems Optimization Optimal Power Flow Distribution

Publication details

Journal / source
IEEE Transactions on Industrial Informatics
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
22
Issue
4
Pages
3126–3137
Publication date
29 January 2026