Tongue Image Segmentation Using YOLOv11-based Object Detection and Mobile Segment Anything Model

View at publisher
Authors: YiMing Liu, Haoyi Fan, S L Wang, Yue Huang, Nan Luo, Haichuan Ren, Huaxing Xu
Cited by: 1
References: 16

Abstract

Tongue image segmentation plays a crucial role in automated tongue diagnosis systems in Traditional Chinese Medicine (TCM), as it directly affects subsequent feature extraction and classification accuracy. Consequently, a myriad of deep learning-based models have been developed. However, most existing methods still rely on large-scale networks with heavy computational requirements and often require manual prompt inputs, which limit their efficiency and practicality in real-world applications. To address these issues, we propose a novel tongue segmentation framework that integrates YOLO-based object detection with the Mobile Segment Anything Model (MobileSAM). Specifically, YOLOv11 is employed to automatically localize the tongue region and generate high-confidence bounding boxes as spatial prompts, enabling MobileSAM to perform precise segmentation without human intervention. The proposed method realizes an end-to-end segmentation process that is both efficient and scalable. Extensive experiments on diverse tongue image datasets demonstrate that the proposed framework achieves accurate and robust segmentation while maintaining low computational cost, highlighting its strong generalization capability and practical value for clinical and research applications.

Fields of Study & Subjects

Traditional Chinese Medicine Studies Salivary Gland Disorders and Functions COVID-19 diagnosis using AI

Publication details

Journal / source
2026 6th International Conference on Neural Networks, Information and Communication Engineering (NNICE)
Publisher
IEEE
Pages
411–417
Publication date
23 January 2026