AI-Aware Operating System Architecture: Redefining Scheduling and Memory Management

Read full text Summarise with VIRAT
Authors: Sneha Pawar, Pranita Deobhankar
Cited by: 0

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Deep learning has rapidly reshaped modern computing, but it has also revealed serious gaps in how traditional operating systems (OS) manage today’s hardware. Most operating systems were built with CPU-focused workloads in mind, and as a result, they fall short when handling the growing mix of GPUs, TPUs, and NPUs that power current AI models. These systems often struggle with coordinating different accelerators, managing separate memory spaces, and keeping up with the fast and frequent data movement required by deep learning tasks. This mismatch leads to delays, inefficient scheduling, high context-switch overhead, and poor utilization of powerful hardware that should ideally boost performance. To overcome these challenges, this paper introduces an OS-level optimization framework designed specifically for AI workloads. The proposed approach adds accelerator-aware scheduling and tensor-aware memory management directly into the kernel, enabling the OS to better understand and respond to the unique demands of deep learning applications. By improving data locality, predicting memory usage patterns, and balancing tasks across heterogeneous devices, the system ensures smoother and more coordinated execution. Experiments conducted using TensorFlow and PyTorch show clear improvements: up to 25% higher throughput, 18% shorter training time, and a 36% reduction in context-switch latency for models such as ResNet-50 and BERT. These gains also translate into lower energy consumption, as accelerators spend less time idling and more time doing useful work. Overall, the findings highlight that making the OS “AI-aware” is not just beneficial—it is essential for achieving the performance, efficiency, and scalability required by modern deep learning systems and the next generation of intelligent computing environments.

Fields of Study & Subjects

Parallel Computing and Optimization Techniques Cloud Computing and Resource Management Distributed and Parallel Computing Systems

Publication details

Journal / source
INTERNATIONAL JOURNAL OF MATHEMATICS AND COMPUTER RESEARCH
Volume
14
Issue
03
Publication date
28 March 2026
Language
EN