CacheCast: Learning-Guided KV Cache Placement for Multi-Tenant Cloud LLM Serving

2026 2nd International Conference on Mechatronics, Robotics, and Artificial Intelligence (MRAI) 2026

View at publisher
Authors: Jianan Sun, Ziyan Hu, Junqi Zhang, Zhenyu Yang, Chong Zhang
DOI: 10.1109/mrai70020.2026.11621074
Cited by: 4
References: 15

Publication details

Journal / source
2026 2nd International Conference on Mechatronics, Robotics, and Artificial Intelligence (MRAI)
Publisher
IEEE
Pages
553–558
Publication date
1 May 2026