CacheRoute: KV-Cache-Aware Routing for LLM Backend Services on Kubernetes

2026 10th International Conference on Electronic Information Technology and Computer Engineering (EITCE) 2026

View at publisher
Authors: Shaorui Pi, Shirui Zhang, Saina Shawulieti
DOI: 10.1109/eitce70137.2026.11634378
Cited by: 7
References: 21

Publication details

Journal / source
2026 10th International Conference on Electronic Information Technology and Computer Engineering (EITCE)
Publisher
IEEE
Pages
695–700
Publication date
1 June 2026