DermNet: integrative CNN-ViT architecture for bias mitigation in dermatological diagnostics using advanced unsupervised lesion segmentation
Abstract
In this paper, we propose a method for reducing the bias in skin disease identification for people of color with the aid of lesion only zero shot unsupervised approach that is then passed to the classifier Dermnet comprising of a hybrid Vision Transformer and Convolutional Neural Network, achieving robust validation accuracy of approximately 81%. Our Segmentation without training with labeled data as is the case with traditional U-Net has achieved an IOU of 90% across all skin colors in segmenting the lesion from skin effectively eradicating the impact of skin in the classification of disease.
Fields of Study & Subjects
Cutaneous Melanoma Detection and Management
Digital Imaging for Blood Diseases
Face recognition and analysis
Publication details
- Journal / source
- Scientific Reports
- Publisher
- Springer Science and Business Media LLC
- Volume
- 16
- Issue
- 1
- Pages
- 5291–5291
- Publication date
- 15 January 2026
- Language
- EN