PSMA PET/MRI‐based Swin Transformer architecture for Gleason Score prediction in prostate cancer

BACKGROUND: Prostate cancer (PCa) management hinges on Gleason Score (GS) assessment, which currently requires invasive biopsies carrying risks of complications. This underscores the demand for noninvasive imaging alternatives. PURPOSE: This study aimed to develop a Swin Transformer-based deep learning framework for noninvasive GS prediction in PCa, utilizing multi-center PSMA PET/MRI data to support clinical decision-making. METHODS: This retrospective study included PCa patients with pathological GS who underwent PSMA PET and MRI scans from three centers. Patients were stratified into training, validation, and testing sets through stratified random sampling. PSMA PET and MRI scans were preprocessed through normalization, segmentation, and data augmentation. Our Swin Transformer architecture integrates a 3D patch embedding layer, four sequential Swin Transformer Blocks with shifted window attention mechanisms, and a multi-layer perceptron (MLP) classification head. Performance was evaluated using AUC, accuracy, sensitivity, specificity, and precision. RESULTS: A total of 225 PCa patients were included in our study. Compared to the PET and T2WI single-modal approaches, the ADC-based single-modal model demonstrated superior performance across all metrics. The multimodal model based on PET, ADC and T2WI showed the best performance, with an AUC of 0.767, sensitivity of 0.722, specificity of 0.815, accuracy of 0.778, and precision of 0.722. CONCLUSION: The Swin Transformer model, leveraging multiparametric and multimodal PSMA PET/MRI data, provides an effective tool for noninvasive GS prediction and clinical decision-making for PCa. Incorporating more data from additional institutions could enhance the model's generalizability and predictive accuracy.