Rethinking Parameter Tuning in Distributed Storage Systems via Knowledge Graph Query

View at publisher
Authors: Wang Zhang, Hongyu Wang, Zhan Shi, Yutong Wu, Mingjin Li, Tingfang Li, Fang Wang, Duo Feng
Cited by: 0
References: 25

Abstract

The growing volume of performance-critical parameters in distributed storage systems, coupled with diverse and dynamic workload patterns, has significantly increased the complexity of system configuration. These trends have expanded the parameter space while tightening the time window for tuning convergence, making it challenging to maintain high system performance. Existing tuning strategies often struggle to balance thorough parameter exploration with real-time responsiveness, limiting their effectiveness under fast-evolving workloads and heterogeneous deployment environments. To address these challenges, we propose KGQW, the first framework that formulates automated parameter tuning as a knowledge graph query workflow. KGQW models workload features and system parameters as graph vertices, with performance metrics represented as edges, and constructs an initial knowledge graph through lightweight performance tests. Guided by performance prediction and Bayesian-driven exploration, KGQW progressively expands the graph, prunes insensitive parameters, and refines performance relationships to build an informative and reusable knowledge graph that supports rapid configuration retrieval via graph querying. Moreover, KGQW enables efficient knowledge transfer across clusters, substantially reducing the construction cost for new clusters. Experiments on real-world applications and storage clusters demonstrate that KGQW achieves second-level tuning latency, while maintaining or surpassing the performance of state-of-the-art methods. These results highlight the promise of knowledge-driven tuning in meeting the scalability and adaptability demands of modern distributed storage systems.

Fields of Study & Subjects

Graph Theory and Algorithms Advanced Data Storage Technologies Cloud Computing and Resource Management

Publication details

Journal / source
IEEE Transactions on Parallel and Distributed Systems
Volume
37
Issue
3
Pages
633–650
Publication date
5 January 2026