Energy Behavior of AI Workloads Under Resource Partitioning in Multi-Tenant Systems

Read full text Summarise with VIRAT
Authors: Jiyoon Kim, Siyeon Kang, Woorim Shin, Kyungwoon Cho, Hyokyung Bahn
Cited by: 0
References: 28

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Traditional cloud pricing models are allocation-centric, where users are charged based on reserved resources rather than workload energy consumption. However, modern AI workloads exhibit substantial and heterogeneous power behavior, limiting the effectiveness of such allocation-centric pricing. This paper presents a comprehensive experimental study of nine widely used workloads across 50 controlled configurations, including standalone and concurrent executions under varying resource partitions. Our results show that total system power is largely unaffected by how resources are divided among co-located workloads, except in cases of explicit resource under-provisioning or severe resource contention. Across 45 workload–core groups, 41 exhibit a coefficient of variation below 3% across different co-located workloads, demonstrating structural stability of workload-level power profiles under heterogeneous execution environments. In contrast, deployment choice (e.g., CPU versus GPU execution) can shift the same model into distinct power regimes. Based on measured power decomposition and scaling behavior, we derive an empirical categorization framework distinguishing GPU-dominant and CPU-dominant workloads, further characterized by utilization and memory dimensions. From an energy perspective, CPU utilization (for CPU-dominant workloads) and SM utilization (for GPU-dominant workloads) emerge as the primary determinants of power magnitude, while memory-related parameters contribute marginally to overall power. These findings provide empirical evidence that allocation-based pricing is a weak proxy for actual energy cost and motivate energy-aligned cloud management strategies grounded in workload power profiles. As our findings are derived from a controlled single-node experiment, evaluations under more realistic data center environments will be required for further generalization.

Fields of Study & Subjects

Cloud Computing and Resource Management Energy Efficiency in Computing Parallel Computing and Optimization Techniques

Publication details

Journal / source
Applied Sciences
Volume
16
Issue
7
Pages
3129–3129
Publication date
24 March 2026
Language
EN