Hierarchical Deep Reinforcement Learning-Based Partial Task Offloading in Device-Edge-Cloud Computing Architecture

View at publisher Summarise with VIRAT
Authors: Ihsan Ullah, Hyun-Kyo Lim, Yeong-Jun Seok, Youn‐Hee Han
Cited by: 0
References: 43

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

The rapid growth of the Intelligent Internet of Things (IIoT) and 5G applications demands high-performance computing, low latency, and energy efficiency, often beyond the capacity of local devices. Task offloading to edge or cloud servers offers a promising solution. However, achieving optimal partial task distribution across device, edge, and cloud remains challenging due to dynamic network conditions, heterogeneous resources, and conflicting performance objectives. This paper presents a Hierarchical Deep Reinforcement Learning (HDRL) framework for intelligent, resource-aware, latency-constrained partial task offloading in device–edge–cloud architectures. The problem is formulated as a two-level Markov Decision Process (MDP) for structured decision-making. At the high level, a Double Deep Q-Network (DDQN) agent observes the global network state and selects computation tiers. At the low level, a Proximal Policy Optimization (PPO) agent determines optimal task-splitting ratios, enabling fine-grained control of subtask distribution. The HDRL framework jointly optimizes energy consumption, task acceptance ratio, and resource utilization while ensuring end-to-end latency constraints. The system adapts dynamically to varying workloads and resource availability. Simulations showed that HDRL-PTO achieved 80–90% task acceptance, reduced energy consumption compared to DRL-PTO and DRL-TO, and consistently delivered higher episode rewards across Network I and II.

Fields of Study & Subjects

IoT and Edge/Fog Computing Energy Efficiency in Computing Cloud Computing and Resource Management

Publication details

Journal / source
IEEE Transactions on Consumer Electronics
Volume
72
Issue
1
Pages
1051–1063
Publication date
1 February 2026
Language
EN