AI-Aware Operating System Architecture: Redefining Scheduling and Memory Management
Summary
No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.
Summarise with VIRAT Free to try with your Science Catalogs account.Abstract
Deep learning has rapidly reshaped modern computing, but it has also revealed serious gaps in how traditional operating systems (OS) manage today’s hardware. Most operating systems were built with CPU-focused workloads in mind, and as a result, they fall short when handling the growing mix of GPUs, TPUs, and NPUs that power current AI models. These systems often struggle with coordinating different accelerators, managing separate memory spaces, and keeping up with the fast and frequent data movement required by deep learning tasks. This mismatch leads to delays, inefficient scheduling, high context-switch overhead, and poor utilization of powerful hardware that should ideally boost performance. To overcome these challenges, this paper introduces an OS-level optimization framework designed specifically for AI workloads. The proposed approach adds accelerator-aware scheduling and tensor-aware memory management directly into the kernel, enabling the OS to better understand and respond to the unique demands of deep learning applications. By improving data locality, predicting memory usage patterns, and balancing tasks across heterogeneous devices, the system ensures smoother and more coordinated execution. Experiments conducted using TensorFlow and PyTorch show clear improvements: up to 25% higher throughput, 18% shorter training time, and a 36% reduction in context-switch latency for models such as ResNet-50 and BERT. These gains also translate into lower energy consumption, as accelerators spend less time idling and more time doing useful work. Overall, the findings highlight that making the OS “AI-aware” is not just beneficial—it is essential for achieving the performance, efficiency, and scalability required by modern deep learning systems and the next generation of intelligent computing environments.
Fields of Study & Subjects
Parallel Computing and Optimization Techniques
Cloud Computing and Resource Management
Distributed and Parallel Computing Systems
Publication details
- Journal / source
- INTERNATIONAL JOURNAL OF MATHEMATICS AND COMPUTER RESEARCH
- Volume
- 14
- Issue
- 03
- Publication date
- 28 March 2026
- Language
- EN