${\sf FinePar}$FinePar: A Fine-Grained Data Partitioning Framework for Cloud-Edge-Device Architectures

View at publisher
Authors: Shuangshuang Cui, Hongzhi Wang, Jinghan Lin, Xiaoou Ding, Donghua Yang
Cited by: 2
References: 34

Abstract

The Cloud-Edge-Device (CED) architecture has emerged as a new framework for real-time data processing in the Internet of Things (IoT) era. However, the edge and device face significant resource constraints that prevent them from storing or processing full datasets. Effective data partition across CED architectures is therefore critical for supporting real-time decision-making. However, existing static and coarse-grained dynamic methods fail to adapt to changing workloads and to meet real-time processing demands. To address this issue, we propose${\sf FinePar}$, a fine-grained dynamic data partitioning framework based on DRL, coupled with an efficient data allocation strategy.${\sf FinePar}$combines horizontal and vertical partition to optimize data partition across CED architectures to reduce data transfer volume and shorten execution time. We use DRL to adjust data partitioning strategies in real time based on task demands and resource states. To achieve end-to-end optimization, we design an efficient data allocation strategy. We verified the effectiveness of${\sf FinePar}$through extensive experiments. Experimental results show that${\sf FinePar}$can reduce the edge side latency by 80% under resource constraints and dynamically adapts to workload changes.

Fields of Study & Subjects

Cloud Computing and Resource Management Big Data and Digital Economy IoT and Edge/Fog Computing

Publication details

Journal / source
IEEE Transactions on Knowledge and Data Engineering
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
38
Issue
4
Pages
2262–2276
Publication date
29 January 2026