CPN-HRL :a hierarchical deep reinforcement learning approach for priority–aware task scheduling in CPN enabled by cloud–edge–end environments
Abstract
A Computing Power Network (CPN) is a cloud–edge–end integrated infrastructure that interconnects heterogeneous computing resources to support latency-sensitive and volatile workloads. A core challenge in CPN task scheduling is to jointly determine task prioritization and computational node selection under dynamic arrivals, resource heterogeneity, and multi-objective conflicts. In this paper, we study dynamic task scheduling in a CPN and aim to (i) minimize average task completion time, (ii) maximize scheduling success rate under deadline constraints, and (iii) improve global resource utilization. We propose CPN-HRL, a hierarchical deep reinforcement learning framework that decomposes scheduling into two coordinated subproblems: a high-level agent (LSTM-PPO) generates global priority weights for queued tasks, and a low-level agent (GAT-PPO) performs topology-aware node selection for each task in the ranked sequence. To further guarantee timeliness for latency-critical tasks, we introduce a two-queue mechanism with an Urgent Queue and a Main Queue, together with a dynamic reordering trigger. Simulation results on multiple real-world topologies show that, under our experimental settings, CPN-HRL reduces average completion time and maintains high scheduling success rate under high loads, while improving overall resource utilization.
Fields of Study & Subjects
Cloud Computing and Resource Management
IoT and Edge/Fog Computing
Software-Defined Networks and 5G
Publication details
- Journal / source
- Journal of King Saud University - Computer and Information Sciences
- Publisher
- Springer Science and Business Media LLC
- Volume
- 38
- Issue
- 5
- Publication date
- 31 March 2026
- Language
- EN