Anatomy-Guided Self-Supervised Distillation Learning for Medical Image Analysis

View at publisher
Authors: Huihui Yu, Qun Dai
Cited by: 2
References: 31

Abstract

3-D medical imaging modalities, including CT and MRI, provide high-resolution views essential for precision medicine. However, the increasing volume and complexity of 3-D medical images challenge manual analysis, particularly in classification and segmentation tasks. Although deep learning has shown considerable promise, it struggles to characterize small-scale, low-contrast anatomical structures, generalize across imaging domains, and mitigate annotation scarcity. Self-supervised learning (SSL) has emerged as an effective and annotation-efficient solution, yet existing methods, largely adapted from natural images, often fail to capture the anatomical heterogeneity and complex semantic dependencies inherent in 3-D medical data. To address these limitations, we propose AG-SSD (Anatomy-Guided Self-Supervised Distillation), a framework that explicitly incorporates anatomical priors into SSL. AG-SSD comprises three complementary modules: 1) cross-view anatomical consistency (CVAC), which generates multi-scale, anatomically consistent positive pairs via overlap-aware cropping; 2) edge-aware adaptive masking (EAAM), which prioritizes anatomy-sensitive, high-edge regions to enhance local feature learning and robust global representation; and 3) cross-view attention alignment (CVAA), which leverages attention-based fusion to achieve semantic compensation and alignment across views, mitigating semantic drift to stabilize distillation. These modules are optimized using a unified objective that combines intra-view patch distillation, inter-view [CLS] token distillation, and masked patch reconstruction. Extensive experiments on CT and MRI datasets demonstrate that AG-SSD consistently outperforms state-of-the-art SSL methods in both classification and segmentation under annotation-scarce scenarios, highlighting its potential as a scalable, label-efficient paradigm for 3-D medical image analysis and clinical applications.

Fields of Study & Subjects

Medical Image Segmentation Techniques Brain Tumor Detection and Classification Retinal Imaging and Analysis

Publication details

Journal / source
IEEE Transactions on Medical Imaging
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
45
Issue
5
Pages
1787–1801
Publication date
6 April 2026
Language
EN