Microservice Scheduling With Spatiotemporal Learning in Dynamic and GPU-CPU Heterogeneous Edge Environment

View at publisher
Authors: Dongping Chen, Xingjian Ding, Tiantian Chen, Jianxiong Guo, Tian Wang, Weijia Jia B
Cited by: 0
References: 31

Abstract

Edge intelligence is rapidly evolving to support computation-intensive applications, yet scheduling containerized microservices in GPU-CPU heterogeneous edge environments remains challenging due to highly dynamic resource availability. Two critical bottlenecks hinder performance: the distinct hardware preferences of microservices, particularly between CPU and GPU architectures, which lead to significant performance gaps when placements are mismatched, and the non-trivial latency of container image downloads. To address these coupled challenges, we propose CHES, a Container-aware Heterogeneous Edge Scheduling framework. Unlike conventional heuristics that evaluate node resources and task sequences independently, our method leverages spatiotemporal learning to capture their joint impact on system performance. Specifically, we design a lightweight CNN to extract spatial correlations from heterogeneous node features, including compute capacity and bandwidth, and employ a GRU to model temporal dependencies among sequential microservice arrivals, where earlier scheduling decisions directly affect resource availability and image cache states for subsequent tasks. These representations are integrated into a Soft Actor-Critic (SAC) agent, enabling an adaptive policy that balances immediate execution latency with long-term image availability costs. Extensive experiments demonstrate that CHES significantly outperforms baselines by effectively aligning hardware-sensitive microservices with optimal nodes and mitigating cold-start overheads in dynamic workloads.

Fields of Study & Subjects

IoT and Edge/Fog Computing Cloud Computing and Resource Management Energy Efficiency in Computing

Publication details

Journal / source
IEEE Transactions on Services Computing
Volume
19
Issue
2
Pages
1392–1405
Publication date
1 March 2026
Language
EN