Disparities in Dermatology AI Performance on a Diverse, Curated Clinical Image Set
Authors:
Roxana Daneshjou,
Kailas Vodrahalli,
Roberto A Novoa,
Melissa Jenkins,
Weixin Liang,
Veronica Rotemberg,
Justin Ko,
Susan M Swetter,
Elizabeth E Bailey,
Olivier Gevaert,
Pritam Mukherjee,
Michelle Phung,
Kiana Yekrang,
Bradley Fong,
Rachna Sahasrabudhe,
Johan A. C. Allerup,
Utako Okata-Karigane,
James Zou,
Albert Chiou
Abstract:
Access to dermatological care is a major issue, with an estimated 3 billion people lacking access to care globally. Artificial intelligence (AI) may aid in triaging skin diseases. However, most AI models have not been rigorously assessed on images of diverse skin tones or uncommon diseases. To ascertain potential biases in algorithm performance in this context, we curated the Diverse Dermatology I…
▽ More
Access to dermatological care is a major issue, with an estimated 3 billion people lacking access to care globally. Artificial intelligence (AI) may aid in triaging skin diseases. However, most AI models have not been rigorously assessed on images of diverse skin tones or uncommon diseases. To ascertain potential biases in algorithm performance in this context, we curated the Diverse Dermatology Images (DDI) dataset-the first publicly available, expertly curated, and pathologically confirmed image dataset with diverse skin tones. Using this dataset of 656 images, we show that state-of-the-art dermatology AI models perform substantially worse on DDI, with receiver operator curve area under the curve (ROC-AUC) drop** by 27-36 percent compared to the models' original test results. All the models performed worse on dark skin tones and uncommon diseases, which are represented in the DDI dataset. Additionally, we find that dermatologists, who typically provide visual labels for AI training and test datasets, also perform worse on images of dark skin tones and uncommon diseases compared to ground truth biopsy annotations. Finally, fine-tuning AI models on the well-characterized and diverse DDI images closed the performance gap between light and dark skin tones. Moreover, algorithms fine-tuned on diverse skin tones outperformed dermatologists on identifying malignancy on images of dark skin tones. Our findings identify important weaknesses and biases in dermatology AI that need to be addressed to ensure reliable application to diverse patients and diseases.
△ Less
Submitted 15 March, 2022;
originally announced March 2022.
Disparities in Dermatology AI: Assessments Using Diverse Clinical Images
Authors:
Roxana Daneshjou,
Kailas Vodrahalli,
Weixin Liang,
Roberto A Novoa,
Melissa Jenkins,
Veronica Rotemberg,
Justin Ko,
Susan M Swetter,
Elizabeth E Bailey,
Olivier Gevaert,
Pritam Mukherjee,
Michelle Phung,
Kiana Yekrang,
Bradley Fong,
Rachna Sahasrabudhe,
James Zou,
Albert Chiou
Abstract:
More than 3 billion people lack access to care for skin disease. AI diagnostic tools may aid in early skin cancer detection; however most models have not been assessed on images of diverse skin tones or uncommon diseases. To address this, we curated the Diverse Dermatology Images (DDI) dataset - the first publicly available, pathologically confirmed images featuring diverse skin tones. We show tha…
▽ More
More than 3 billion people lack access to care for skin disease. AI diagnostic tools may aid in early skin cancer detection; however most models have not been assessed on images of diverse skin tones or uncommon diseases. To address this, we curated the Diverse Dermatology Images (DDI) dataset - the first publicly available, pathologically confirmed images featuring diverse skin tones. We show that state-of-the-art dermatology AI models perform substantially worse on DDI, with ROC-AUC drop** 29-40 percent compared to the models' original results. We find that dark skin tones and uncommon diseases, which are well represented in the DDI dataset, lead to performance drop-offs. Additionally, we show that state-of-the-art robust training methods cannot correct for these biases without diverse training data. Our findings identify important weaknesses and biases in dermatology AI that need to be addressed to ensure reliable application to diverse patients and across all disease.
△ Less
Submitted 15 November, 2021;
originally announced November 2021.
