Automatic segmentation-based multi-modal radiomics analysis of US and MRI for predicting disease-free survival of breast cancer: a multicenter study

Several studies have confirmed the potential value of applying radiomics to predict prognosis of breast cancer. However, the tumor segmentation in these studies depended on delineation or annotation of breast cancer by radiologist, which is often laborious, tedious, and vulnerable to inter- and intra-observer variability. Automatic segmentation is expected to overcome this difficulty. Herein, we aim to investigate the value of automatic segmentation-based multi-modal radiomics signature and magnetic resonance imaging (MRI) features in predicting disease-free survival (DFS) of patients diagnosed with invasive breast cancer. This retrospective multicenter study included a total of 643 female patients with invasive breast cancer who underwent preoperative ultrasound (US) and MRI for prognostic analysis. Data (n = 480) from center 1 were divided into training and internal testing sets, while data (n = 163) from centers 2 and 3 were analyzed as the external testing set. We developed automatic segmentation frameworks for tumor segmentation by deep learning. Then, Least absolute shrinkage and selection operator Cox regression was used to select features to construct radiomics signature, and corresponding radiomics score (Rad-score) was calculated. Finally, six models for predicting DFS were constructed by using Cox regression and assessed in terms of discrimination, calibration, and clinical usefulness. The multi-modal radiomics signature combining intra- and peri-tumoral radiomics signatures of US and MRI achieved a higher C-index in the internal (0.734) and external (0.708) testing sets than most other radiomics signatures in predicting DFS, and successfully stratified patients into low- and high-risk groups. The multi-modal clinical imaging model combining the multi-modal Rad-score and clinical traditional MRI model-score resulted in a higher C-index (0.795) than other models in the external testing set, and it had a better calibration and higher clinical benefit. This study demonstrates that the multi-modal radiomics signature derived from automatic segmentations of US and MRI is a promising risk stratification biomarker for breast cancer, and highlights that the appropriate combination of multi-modal radiomics signature, clinical characteristics, and MRI feature can improve performance of individualized DFS prediction, which might assist in guiding decision-making related to breast cancer.