Diagnostic Performance of O-RADS US (Version 2019 and Version 2022) Incorporating Acoustic Shadowing by Junior Radiologists: Analyzing 1061 Adnexal Masses

Acoustic shadowing is an important benign ultrasound (US) feature for adnexal masses (AMs). To validate the diagnostic performance and interobserver agreement of the 2019 version and 2022 version of Ovarian-Adnexal Reporting and Data System Ultrasound (O-RADS US) and ascertain whether adding acoustic shadowing to O-RADS US v2019 as a benign ultrasound feature can enhance its diagnostic efficacy among junior radiologist. This retrospective study included consecutive women with suspected adnexal masses who underwent ultrasound examinations between September 2022 and January 2024. One junior doctor (Reader 1, 2 years of experience) classified each AM according to the O-RADS US v2019 and the v2022. Lesions were reclassified according to the US features of acoustic shadowing based on the O-RADS US v2019: the O-RADS category was downgraded by one level with acoustic shadowing and remained unchanged without acoustic shadowing for categories 2-5. Receiver operating characteristic (ROC) curve analysis was used to evaluate the diagnostic performance of the two versions of O-RADS and the modified O-RADS model. Two independent junior radiologists (Reader 1 and Reader 2 with 3 years of experience) then classified the 200 AMs randomly selected for a test-retest analysis. Kappa (к) statistics were used to assess the interobserver agreement. Overall, 1015 women (range, 16-86 years) with 1061 AMs were evaluated. Of the lesions, 864 (81.4%) were benign and 197 (18.6%) were malignant. The area under the ROC curve (AUC) for O-RADS v2019 and v2022 were 0.920 (95% confidence interval [CI]: 0.902, 0.936, P