Performance of an Artificial Intelligence Model for Recognition and Quantitation of Histologic Features of Eosinophilic Esophagitis on Biopsy Samples

We have developed an artificial intelligence (AI)–based digital pathology model for the evaluation of histologic features related to eosinophilic esophagitis (EoE). In this study, we evaluated the performance of our AI model in a cohort of pediatric and adult patients for histologic features included in the Eosinophilic Esophagitis Histologic Scoring System (EoEHSS). We collected a total of 203 esophageal biopsy samples from patients with mucosal eosinophilia of any degree (91 adult and 112 pediatric patients) and 10 normal controls from a prospectively maintained database. All cases were assessed by a specialized gastrointestinal (GI) pathologist for features in the EoEHSS at the time of original diagnosis and rescored by a central GI pathologist (R.K.M.). We subsequently analyzed whole-slide image digital slides using a supervised AI model operating in a cloud-based, deep learning AI platform (Aiforia Technologies) for peak eosinophil count (PEC) and several histopathologic features in the EoEHSS. The correlation and interobserver agreement between the AI model and pathologists (Pearson correlation coefficient [rs] = 0.89 and intraclass correlation coefficient [ICC] = 0.87 vs original pathologist; rs = 0.91 and ICC = 0.83 vs central pathologist) were similar to the correlation and interobserver agreement between pathologists for PEC (rs = 0.88 and ICC = 0.91) and broadly similar to those for most other histologic features in the EoEHSS. The AI model also accurately identified PEC of >15 eosinophils/high-power field by the original pathologist (area under the curve [AUC] = 0.98) and central pathologist (AUC = 0.98) and had similar AUCs for the presence of EoE-related endoscopic features to pathologists’ assessment. Average eosinophils per epithelial unit area had similar performance compared to AI high-power field–based analysis. Our newly developed AI model can accurately identify, quantify, and score several of the main histopathologic features in the EoE spectrum, with agreement regarding EoEHSS scoring which was similar to that seen among GI pathologists.