${\sf FinePar}$FinePar: A Fine-Grained Data Partitioning Framework for Cloud-Edge-Device Architectures
Abstract
The Cloud-Edge-Device (CED) architecture has emerged as a new framework for real-time data processing in the Internet of Things (IoT) era. However, the edge and device face significant resource constraints that prevent them from storing or processing full datasets. Effective data partition across CED architectures is therefore critical for supporting real-time decision-making. However, existing static and coarse-grained dynamic methods fail to adapt to changing workloads and to meet real-time processing demands. To address this issue, we propose${\sf FinePar}$, a fine-grained dynamic data partitioning framework based on DRL, coupled with an efficient data allocation strategy.${\sf FinePar}$combines horizontal and vertical partition to optimize data partition across CED architectures to reduce data transfer volume and shorten execution time. We use DRL to adjust data partitioning strategies in real time based on task demands and resource states. To achieve end-to-end optimization, we design an efficient data allocation strategy. We verified the effectiveness of${\sf FinePar}$through extensive experiments. Experimental results show that${\sf FinePar}$can reduce the edge side latency by 80% under resource constraints and dynamically adapts to workload changes.
Fields of Study & Subjects
Cloud Computing and Resource Management
Big Data and Digital Economy
IoT and Edge/Fog Computing
Publication details
- Journal / source
- IEEE Transactions on Knowledge and Data Engineering
- Publisher
- Institute of Electrical and Electronics Engineers (IEEE)
- Volume
- 38
- Issue
- 4
- Pages
- 2262–2276
- Publication date
- 29 January 2026