Deep-Learning Algorithm Diagnostic Support for Usual Interstitial Pneumonia Pattern Recognition in Fibrotic Interstitial Lung Disease

Background and Objective: High resolution computed tomography (HRCT) scan diagnostic classification for usual interstitial pneumonia (UIP) plays a critical role in therapeutic decision-making and clinical trial eligibility for interstitial lung disease (ILD) patients, but is subject to variability. A deep learning algorithm, the Systematic Objective Fibrotic Imaging Analysis Algorithm (SOFIA), has been validated to assist classification of HRCTs based on current guidelines. In this study, we evaluate the impact
of SOFIA on inter-observer
agreement for UIP classification and prognostic accuracy of clinicians' assessment of ILD HRCTs.
Methods: Radiologists and pulmonologists (reviewers) were invited to evaluate 203 HRCTs from a national fibrotic ILD registry,
scoring each of four UIP categories (definite UIP, probable UIP, indeterminate, or alternative diagnosis). SOFIA outputs were
then provided, and reviewers were able to reevaluate their scores. Changes in interobserver agreement for UIP classification and
prognostic accuracy were calculated.
Results: Three hundred twelve reviewers (120 radiologists, 192 pulmonologists) from 49 countries evaluated 203 HRCT scans.
Following SOFIA, inter-observer
diagnostic agreement improved for definite UIP from moderate to good (ICCpre = 0.54[0.50–
0.60]; ICCpost = 0.70[0.66–0.74]), and for probable UIP from fair to moderate (ICCpre = 0.30[0.27–0.35]; ICCpost = 0.53[0.49–0.58]).
Following SOFIA, there was improved prognostic accuracy for reviewers' definite UIP, probable UIP, and indeterminate scores (significant change in c-index),
and the proportion of reviewers whose probable UIP scores were significantly predictive of
transplant-free
survival increased by 42%.
Conclusion: Providing SOFIA algorithm output to clinicians reviewing HRCT scans improved diagnostic agreement and prognostic accuracy for fibrotic ILD. SOFIA may be a useful automated assistive tool to support improved diagnostic consistency.