Clara Koo, Anthony Yang, Colton Welch, Vipashyana Jadav, Liana Posch, Nicholas Thoreson, Darrell Morris, Fatima Chouhdry, Janet Szabo, David Mendelson, Laurie R. Margolies
Journal of Medical Imaging, Vol. 10, Issue 06, 061108, (December 2023) https://doi.org/10.1117/1.JMI.10.6.061108
TOPICS: Artificial intelligence, Pathology, Ultrasonography, Breast, Biopsy, Breast cancer, Diagnostics, Imaging systems, Cancer detection, Mammography
Purpose
Breast ultrasound suffers from low positive predictive value and specificity. Artificial intelligence (AI) proposes to improve accuracy, reduce false negatives, reduce inter- and intra-observer variability and decrease the rate of benign biopsies. Perpetuating racial/ethnic disparities in healthcare and patient outcome is a potential risk when incorporating AI-based models into clinical practice; therefore, it is necessary to validate its non-bias before clinical use.
Approach
Our retrospective review assesses whether our AI decision support (DS) system demonstrates racial/ethnic bias by evaluating its performance on 1810 biopsy proven cases from nine breast imaging facilities within our health system from January 1, 2018 to October 28, 2021. Patient age, gender, race/ethnicity, AI DS output, and pathology results were obtained.
Results
Significant differences in breast pathology incidence were seen across different racial and ethnic groups. Stratified analysis showed that the difference in output by our AI DS system was due to underlying differences in pathology incidence for our specific cohort and did not demonstrate statistically significant bias in output among race/ethnic groups, suggesting similar effectiveness of our AI DS system among different races (p > 0.05 for all).
Conclusions
Our study shows promise that an AI DS system may serve as a valuable second opinion in the detection of breast cancer on diagnostic ultrasound without significant racial or ethnic bias. AI tools are not meant to replace the radiologist, but rather to aid in screening and diagnosis without perpetuating racial/ethnic disparities.