The interreader agreement and validation of contrast-enhanced ultrasound liver imaging reporting and data system

•Interreader agreement for CEUS LI-RADS categories and major features is substantial.•CEUS LI-RADS is a promising standardized categorization system for high-risk patients.•The combination of two or three LR-M features may improve the true-negative classification of HCC diagnosis. This study explored the interreader agreement and diagnostic performance of contrast-enhanced ultrasound liver imaging reporting and data system (CEUS LI-RADS). Between January 2014 and December 2017, 1366 patients at risk for hepatocellular carcinoma (HCC) who underwent CEUS were included in this retrospective study. Four ultrasound physicians rated the HCC likelihood of focal liver lesions (FLLs) using CEUS LI-RADS v2017. Interreader agreement on CEUS LI-RADS categories and major features (arterial phase hyperenhancement (APHE), washout appearance) were assessed using weighted kappa statistics (κ). Diagnostic performance was described by sensitivity, specificity, PPV and NPV, +LR, -LR. The interreader agreement (κ) for CEUS LI-RADS categories, APHE, and washout appearance ranged from 0.61 to 0.73, 0.65 to 0.83, and 0.58 to 0.71, respectively. Interreader agreement for LI-RADS categories and APHE were almost substantial between FLLs