Radiomics of contrast-enhanced spectral mammography for prediction of pathological complete response to neoadjuvant chemotherapy in breast cancer
Abstract
BACKGROUND:
Neoadjuvant chemotherapy (NAC) has been regarded as one of the standard treatments for patients with locally advanced breast cancer. No previous study has investigated the feasibility of using a contrast-enhanced spectral mammography (CESM)-based radiomics nomogram to predict pathological complete response (pCR) after NAC.
OBJECTIVE:
To develop and validate a CESM-based radiomics nomogram to predict pCR after NAC in breast cancer.
METHODS:
A total of 118 patients were enrolled, which are divided into a training dataset including 82 patients (with 21 pCR and 61 non-pCR) and a testing dataset of 36 patients (with 9 pCR and 27 non-pCR). The tumor regions of interest (ROIs) were manually segmented by two radiologists on the low-energy and recombined images and radiomics features were extracted. Intraclass correlation coefficients (ICCs) were used to assess the intra- and inter-observer agreements of ROI features extraction. In the training set, the variance threshold, SelectKBest method, and least absolute shrinkage and selection operator regression were used to select the optimal radiomics features. Radiomics signature was calculated through a linear combination of selected features. A radiomics nomogram containing radiomics signature score (Rad-score) and clinical risk factors was developed. The receiver operating characteristic (ROC) curve and calibration curve were used to evaluate prediction performance of the radiomics nomogram, and decision curve analysis (DCA) was used to evaluate the clinical usefulness of the radiomics nomogram.
RESULTS:
The intra- and inter- observer ICCs were 0.769–0.815 and 0.786–0.853, respectively. Thirteen radiomics features were selected to calculate Rad-score. The radiomics nomogram containing Rad-score and clinical risk factor showed an encouraging calibration and discrimination performance with area under the ROC curves of 0.906 (95% confidence interval (CI): 0.840–0.966) in the training dataset and 0.790 (95% CI: 0.554–0.952) in the test dataset.
CONCLUSIONS:
The CESM-based radiomics nomogram had good prediction performance for pCR after NAC in breast cancer; therefore, it has a good clinical application prospect.
List of abbreviations
Abbreviations | Full name |
ADC | Apparent diffusion coefficient |
CA125 | Carbohydrate antigen 125 |
CA153 | Carbohydrate antigen 153 |
CC | Cranial caudal |
CEA | Carcinoembryonic antigen |
CESM | Contrast-enhanced spectral mammography |
CI | Confidence interva |
CSCO | Chinese society of clinical oncology |
DCA | Decision curve analysis |
ER | Estrogen receptor |
HER2 | Epidermal growth factor receptor-2 |
ICCs | Intraclass correlation coefficients |
IHC | Immunohistochemistry |
LASSO | Selection operator |
MLO | Mediolateral oblique |
MRI | Magnetic resonance imaging |
NAC | Neoadjuvant chemotherapy |
NCCN | National comprehensive cancer network |
pCR | Pathological complete response |
PET/CT | Positron emission tomography/computed tomography |
PR | Progesterone receptor |
ROC | Receiver operating characteristic |
ROIs | Regions of interest |
1Introduction
Neoadjuvant chemotherapy (NAC) has been regarded as one of the standard treatments for patients with locally advanced breast cancer, and for patients with triple-negative or human epidermal growth factor receptor-2 (HER2)–positive tumor biological expression [1]. It is a preoperative systemic treatment that can provide information to predict the prognosis for each patient, detect the sensitivity of the tumor to the drug, reduce the local size of the tumor, reduce the scope of surgery, and even achieve pathological complete response (pCR) [2]. pCR is the absence of invasive tumor cells within excised breast and related tissues following NAC [3], while non-pCR refers to patients with partial response or no response, meaning that invasive cancer remains after NAC. Patients with pCR have a better prognosis than those with non-pCR [4, 5]. However, only 10% –50% of patients with breast cancer can achieve pCR after NAC treatment [6]. Some patients cannot benefit from NAC and are negatively influenced by the toxicity and adverse effects caused by chemotherapy owing to their poor pathological response. Therefore, a noninvasive and effective method for predicting pCR in patients undergoing NAC without delaying patient treatment is needed.
Several studies have demonstrated the potential of Magnetic resonance imaging (MRI) in predicting the efficacy of NAC. Some MRI studies [7–9] have a certain guiding importance in clinical practice. However, breast MRI has some problems. It is expensive and time consuming, and its high sensitivity leads to additional examinations and biopsies [10, 11]. MRI also has some relative contraindications, such as patients with metal substances in their bodies and patients suffering from claustrophobia, which limits the application of MRI [12]. Contrast-enhanced spectral mammography (CESM) is a new, simpler, and more cost-effective test and is a better supplement for breast imaging than MRI. CESM combines an iodinated contrast agent with conventional mammography to improve diagnostic accuracy [13]. Many pieces of evidence indicate that the performance of CESM is equivalent to that of MRI, and CESM can improve specificity and reduce false-positive interpretations [14].
With the rapid development of technology, radiomics has developed rapidly as a new tool for noninvasive tumor analysis [15]. Radiomics has shown excellent performance in predicting breast cancer prognosis [16, 17]. Related studies on CESM-based radiomics have also achieved good results in predicting axillary lymph node metastasis in breast cancer, even neoadjuvant chemotherapy-insensitive breast cancers, and in distinguishing benign and malignant breast lesions [18–22]. Among them, the radiomics of CESM applied to neoadjuvant chemotherapy is only to predict the efficacy of neoadjuvant chemotherapy [19, 22]. However, the application of CESM-based radiomics before surgery to predict the pathological complete response of patients after NAC has not been reported yet.
The purpose of this study was to develop a CESM-based radiomics nomogram for pCR prediction in patients with locally advanced breast cancer.
2Materials and methods
2.1Patients
This study was approved by the institutional review board of Yantai Yuhuangding Hospital, and the patients right to informed consent was waived.
A total of 196 patients with locally advanced breast cancer who had underwent CESM examination before NAC treatment from March 2018 to January 2021 were enrolled. The inclusion criteria were as follows: (i) the patients had biopsy-confirmed unilateral primary invasive breast cancer before NAC; (ii) the patients received no treatment other than NAC and completed the full course of NAC; (iii) surgery was followed by the completion of NAC, and postoperative pathology was obtained; and (iv) the CESM examination was conducted 2 weeks before NAC. The exclusion criteria were as follows: (i) multifocal, bilateral, or occult breast cancer; (ii) lack of pre-treatment CESM image or clinical data; (iii) the patients who received non-standard treatment or did not complete the NAC regimen; (iv) no surgery was performed or the results of postoperative pathological immunohistochemistry (IHC) were incomplete; and (v) the image quality of CESM is insufficient to obtain measurement results. Finally, 118 patients were included in this study and randomly divided into a training set (n = 82, included 21 pCR and 61 non-pCR) and a test set (n = 36, included 9 pCR and 27 non-pCR) in a ratio of 7:3. We also repeated this training/testing process 6 times to prevent biases from in case partition. The screening diagram of the study population is shown in Fig. 1.
Fig. 1
Flow chart of patient enrolment.
![Flow chart of patient enrolment.](https://ip.ios.semcs.net:443/media/xst/2023/31-4/xst-31-4-xst221349/xst-31-xst221349-g001.jpg)
2.2CESM data acquisition
The CESM used in our breast center is based on a full-digital breast machine (Senographe DS SenoBright, GE Healthcare). The contrast agent Omnipaque 300 (GE Healthcare, Inc., Princeton, NJ) is injected through the patient’s upper arm vein at a dose of 1.5 mg/kg and a flow rate of 3.0 mL/s. About 2 min after the contrast agent is injected, the bilateral breasts are pressed in the cranial caudal (CC) view and mediolateral oblique (MLO) view. Moreover, low- and high-energy images are rapidly acquired. Usually, the contralateral mammary gland is photographed first and then the suspicious side is photographed. Bilateral breast CC and MLO views are photographed at low- and high-energy exposures. Low- and high-energy exposures are continuously performed within 1.5 s, and then recombined images are obtained using a post-processing system. The low-energy image is similar to a conventional mammogram, whereas the recombined image shows the contrast medium uptake [13].
2.3Clinical and histopathological characteristics
Clinical and histopathological data were obtained from the medical record system, including age, carcinoembryonic antigen (CEA), carbohydrate antigen 153 (CA153), carbohydrate antigen 125 (CA125), and molecular subtype (according to the status of estrogen receptor [ER], progesterone receptor [PR], epidermal growth factor receptor-2 [HER2], and proliferation marker Ki-67). Immunohistochemical (IHC) staining shows the stained tumor cell nuclei:< 1% positive tumor cells mean ER/PR negative and≥1% positive tumor cells mean ER/PR positive [23]. The cutoff level for Ki67 is 20%. The IHC results for HER2 status were interpreted as follows:+3 was defined as positive, 0 to+1 was defined as negative, and+2 required a fluorescence in situ hybridization (FISH) of the biopsied tissue for validation. The non-amplified FISH results were considered HER2–, whereas the amplified FISH results were defined as HER2 + [24]. Tumors were stratified into molecular subtypes using IHC surrogate markers. Luminal A was defined as ER positive, PR (20%) positive, HER2 negative, and Ki67 < 20%. Luminal B was defined as ER positive and/or PR (< 20%) positive, HER2 negative or ER/PR/HER2 positive, or ER and PR positive but Ki67 > 20%. HER2 positive was defined as ER/PR negative and HER2 positive. The triple-negative group was defined as ER/PR/HER2 negative.
2.4NAC and pathological assessment
In accordance with the National Comprehensive Cancer Network (NCCN) guideline and Chinese Society of Clinical Oncology (CSCO) guideline for breast cancer, all patients received six or eight cycles of NAC before breast surgery. The NAC regimens were based on taxane (11 patients, 9.3%) or taxane and anthracycline (107 patients, 90.7%). All HER2-positive patients also received trastuzumab or trastuzumab and pertuzumab. Surgical operations were performed 2–3 weeks after completing NAC.
pCR is defined as the absence of residual infiltrating primary breast cancer (which can be ductal carcinoma in situ) and residual regional lymph nodes after completing NAC [3], while non-pCR refers to patients with partial response or no response, meaning that invasive cancer remains after NAC.
2.5Region of interest segmentation and radiomic feature extraction
The radiologist 1 (with 9 years of experience in breast imaging) manually segmented the tumor regions of interest (ROIs) by following the outline of the tumor on the low-energy and recombined images of the CC and MLO views on ITK-SNAP software (version 3.8.0). The sample ROI segmentation is shown in Fig. 2.
Fig. 2
Examples of regions of interest (ROIs) segmentation on contrast-enhanced spectral mammography (CESM) images. (A, C) The low-energy and recombined images with cranial caudal (CC) view. (B, D) The low-energy and recombined images with mediolateral oblique (MLO) view. The ROIs of breast lesions were drawn manually on low-energy and recombined images, respectively.
![Examples of regions of interest (ROIs) segmentation on contrast-enhanced spectral mammography (CESM) images. (A, C) The low-energy and recombined images with cranial caudal (CC) view. (B, D) The low-energy and recombined images with mediolateral oblique (MLO) view. The ROIs of breast lesions were drawn manually on low-energy and recombined images, respectively.](https://ip.ios.semcs.net:443/media/xst/2023/31-4/xst-31-4-xst221349/xst-31-xst221349-g002.jpg)
Image preprocessing is required before feature extraction. It includes the standardization of the gray value of the ROI, discretization of gray level, and image resampling. The μ±3σ method is used to standardize the image of the ROI. Image normalization can improve the texture difference features between two image classes [25]. Therefore, normalization was performed first, and the gray value greater than μ±3σ was set to 0. The gray scale of the image was adjusted by gray scale discretization. In this study, 64 gray levels were used to reduce the calculation time and effect of noise [18, 26]. Finally, the image was re-sampled to ensure that the scale of the feature was unchanged, and the anisotropic pixel was converted to 0.1 mm×0.1 mm [27].
Radiomics features were then extracted from each ROI of the low-energy images and the recombined images from CC and MLO views respectively using “RadiomicsFeatureExtractor” by Pyradiomics, including three categories: first-order features (270), shape-based features (14), and texture features (1125).
2.6Intra- and interobserver agreement of feature extraction
Intraclass correlation coefficients (ICCs) were used to assess the intra- and inter-observer agreement of ROI feature extraction to evaluate the reproducibility of radiomics feature extraction. The CESM images of 30 patients were randomly selected to calculate ICCs. Radiologist 1 repeated the ROI segmentation after 2 months to evaluate intra-observer agreement. Radiologist 2 (with 13 years of experience in breast imaging) segmented the ROIs manually and extracted features using the same method to evaluate inter-observer agreement. ICC > 0.75 was considered a good agreement, and features with ICCs > 0.75 within the training set were used for further analysis.
2.7Radiomics feature selection and radiomics score construction
Radiomics features were selected by low variance method, SelectKBest method, and least absolute shrinkage and selection operator (LASSO) in the training set. In the low variance method, the threshold was 0.8, and the eigenvalues of the variance larger than 0.8 were included. In the SelectKBest method, the features with p < 0.05 between NAC pCR and NAC non-pCR were selected. LASSO regression was finally used for selecting the key radiomics features with non-zero coefficients. The 7-fold cross-validation was used to select the optimal tuning parameter (alpha) of LASSO via minimum criteria. Radiomics score (Rad-score) was calculated using a linear combination of the final selected features weighted by their LASSO coefficients. The area under the receiver operating characteristic (ROC) curve (AUC) value of Rad-score was calculated to assess the predictive performance of radiomics features.
2.8Radiomics nomogram construction and assessment
In the training set, univariate and multivariate logistic regression were used to select independent predictive factors, including clinic radiological characteristics (age, CEA, CA153, CA125, ER, PR, HER-2, Ki67, tumor size, and molecular subtypes) and Rad-score. Factors with p < 0.05 in were selected as independent predictive factors and were integrated into the multivariate logistic regression. Likelihood ratio test with backward step-down selection was applied for logistic regression. With Akaike information as the criterion, when the minimum Akaike information criterion was reached, the step-by-step process was stopped. A radiomics nomogram incorporating Rad-score and independent predictive factors was built by multivariate logistic regression, which could be used as a convenient visible tool to predict the individual probability of NAC pCR. To train the model, we performed a grid search and fivefold cross-validation to find the optimal parameters in the training set and examine the performance of generalization. The accuracy of the model was taken as the indicator for extracting the model parameters. We then trained the model using the entire training set.
The predictive performance of the radiomics nomogram was evaluated by ROC in the training and test sets. In addition, the point on the ROC curve farthest from the diagonal line corresponds to the largest Youden index, which is calculated by the sum of sensitivity and specificity and then subtracting 1 over all the possible threshold values. This index was used to determine the cutoff value for dividing the patients with NAC pCR and NAC non-pCR. Accuracy, sensitivity, and specificity were calculated in the training and test sets according to the cutoff value.
The agreement between the observed results and predictive probability was assessed by calibration curve. Decision curve analysis (DCA) was employed to evaluate the net benefit of the radiomics nomogram under the different threshold probabilities.
2.9Statistical analysis
The statistical analysis was conducted in Python (version 3.6), R software (version 3.4.1), and SPSS (version 26). The categorical clinical variables (ER, PR, HER-2, Ki67, and molecular subtypes) between training and test sets were compared using the chi-square test or Fisher’s exact test, whereas continuous clinical variables (age, tumor size, CEA, CA153, and CA125) were analyzed by two-sample t test. The “glmnet” and “glm” packages were used for LASSO logistic regression. The “rms” and “pROC” packages were used for nomogram construction and ROC analysis, respectively. The “Calibration Curves” package was used for calibration curve analysis, whereas the “Decision Curve” package was used for DCA. p < 0.05 was interpreted as statistically significant difference.
3Results
3.1Clinical characteristics
A total of 118 patients were finally enrolled in this retrospective study. 82 patients (with 21 pCR, 61 non-pCR) were included in the training set, and 36 patients (with 9 pCR, 27 non-pCR) were included in the test set. The patient characteristics in the training and test sets are shown in Table 1. Significant differences in ER (p = 0.048) and PR (p = 0.002) but no significant differences in age (p = 0.135), diameter (p = 0.624), CEA (p = 0.329), CA153 (p = 0.525), CA152 (p = 0.354), HER2 (p = 0.405), Ki-67 (p = 0.440), and molecular subtype (p = 0.202) were found between NAC pCR and NAC non-pCR in the training set.
Table 1
Clinico-radiological characteristics in the training and validation cohorts
Training set (n = 82) | Validation set (n = 36) | |||||
pCR (n = 21) | non-pCR (n = 61) | P | pCR (n = 9) | non-pCR (n = 27) | P | |
Age, years (mean±SD) | 52.5±9.8 | 48.8±9.6 | 0.135 | 51.3±9.5 | 52.5±10.3 | 0.771 |
Diameter, cm (mean±SD) | 4.6±2.3 | 5.0±2.8 | 0.624 | 3.1±1.2 | 4.8±2.6 | 0.012 |
CEA (ng/ml±SD) | 44.3±190.5 | 2.7±3.3 | 0.329 | 11.0±14.1 | 5.4±10.6 | 0.217 |
CA153 (U/ml±SD) | 15.6±22.3 | 19.9±27.7 | 0.525 | 14.7±11.5 | 20.1±14.4 | 0.314 |
CA125 (U/ml±SD) | 18.0±11.4 | 27.8±47.7 | 0.354 | 21.1±18.8 | 27.9±54.2 | 0.718 |
ER | 0.048 | 0.005 | ||||
Negative | 10 | 15 | 7 | 6 | ||
Positive | 11 | 46 | 2 | 21 | ||
PR | 0.002 | 0.018 | ||||
Negative | 14 | 17 | 8 | 10 | ||
Positive | 7 | 44 | 1 | 17 | ||
HER2 | 0.405 | 0.001 | ||||
Negative | 12 | 41 | 1 | 20 | ||
Positive | 9 | 20 | 8 | 7 | ||
Ki-67 | 0.440 | 1.000 | ||||
Negative | 1 | 9 | 2 | 7 | ||
Positive | 20 | 52 | 7 | 20 | ||
Molecular Subtype | 0.202 | 0.009 | ||||
Luminal A | 1 | 5 | 0 | 3 | ||
Luminal B | 10 | 42 | 2 | 18 | ||
HER2 over expression | 4 | 7 | 6 | 3 | ||
Triple negative | 6 | 7 | 1 | 3 |
SD, standard deviation; CEA, carcinoembryonic antigen; CA153, carbohydrate antigen 153; CA125 carbohydrate antigen 125; ER, estrogen receptor; PR, progesterone receptor; HER2, epidermal growth factor receptor-2; Ki-67, proliferation marker; pCR, pathological complete response.
3.2Radiomics feature selection and radiomics score development
A total of 5636 radiomics features were extracted from each patient’s CESM images. The intra- and inter- observer ICCs among 5636 radiomics features were 0.769–0.815 and 0.786–0.853, respectively, which represented good reproducibility in radiomics feature extraction.
Moreover, 4110 radiomics features were selected by low variance method, and 33 radiomics features were further selected by SelectKBest method. Finally, the optimal 13 radiomics features with non-zero coefficients in LASSO logistic regression were selected, whereas the optimal value of alpha was 0.0198, and the optimal –log(alpha) was 1.7 (Fig. 3, Table 2). The Rad-score of each patient was calculated by the 13 radiomics features.
Fig. 3
Lasso algorithm for radiomics features selection. (a) Least absolute shrinkage and selection operator (LASSO) coeffificient profifiles of the 33 features. The y-axis represents coeffificient of each feature. The optimal value of alpha was 0.0198, and the optimal -log(alpha) was 1.7, where 13 features with non-zero coeffificient were selected. (b) Mean square error path using seven-fold cross-validation.
![Lasso algorithm for radiomics features selection. (a) Least absolute shrinkage and selection operator (LASSO) coeffificient profifiles of the 33 features. The y-axis represents coeffificient of each feature. The optimal value of alpha was 0.0198, and the optimal -log(alpha) was 1.7, where 13 features with non-zero coeffificient were selected. (b) Mean square error path using seven-fold cross-validation.](https://ip.ios.semcs.net:443/media/xst/2023/31-4/xst-31-4-xst221349/xst-31-xst221349-g003.jpg)
Table 2
Radiomics feature for establishing radiomics score
Radiomics Features | view | Modality | Coefficient |
wavelet-HHH_firstorder_Mean | CC | Recombined image | –0.080037993 |
wavelet-HHL_glrlm_HighGrayLevelRunEmphasis | CC | Recombined image | 0.048776836 |
wavelet-HHL_glrlm_LowGrayLevelRunEmphasis | CC | Recombined image | –2.19E–08 |
wavelet-HHL_gldm_GrayLevelVariance | MLO | Recombined image | –0.01470699 |
wavelet-HHL_glrlm_ShortRunLowGrayLevelEmphasis | MLO | Recombined image | 0.010598986 |
wavelet-HLH_gldm_LargeDependenceHighGrayLevelEmphasis | CC | Recombined image | –0.020753821 |
wavelet-HHH_glcm_SumSquares | MLO | Recombined image | –0.01982842 |
wavelet-HLH_glszm_GrayLevelNonUniformity | MLO | Recombined image | –0.030070211 |
wavelet-HLL_glrlm_ShortRunLowGrayLevelEmphasis | CC | Low-energy image | 0.061813611 |
wavelet-LHH_glrlm_GrayLevelNonUniformityNormalized | CC | Low-energy image | 0.025723448 |
wavelet-HHH_glszm_SmallAreaHighGrayLevelEmphasis | CC | Low-energy image | 0.100427095 |
wavelet-HLL_glrlm_HighGrayLevelRunEmphasis | CC | Low-energy image | –0.010935022 |
wavelet-HHH_gldm_DependenceEntropy | CC | Low-energy image | 0.006643032 |
glszm, gray level size zone matrix; glrlm, gray level run length matrix; gldm, gray level dependence matrix; glcm, gray level co-occurrence matrix.
3.3Radiomics nomogram construction
In univariate logistic regression, ER (P = 0.049), PR (P = 0.001), molecular subtypes (P = 0.034), and Rad-score (P < 0.01) were included into multivariate logistic regression. After multivariate logistic regression, Rad-score and PR were remarkably related to pCR after NAC (both P < 0.001). Thus, the radiomics nomogram was developed with the combination of Rad-score and PR as shown in Fig. 4.
Fig. 4
A radiomics nomogram with Rad-score and PR incorporated for predicting the probability of NAC pCR in breast cancer patients.
![A radiomics nomogram with Rad-score and PR incorporated for predicting the probability of NAC pCR in breast cancer patients.](https://ip.ios.semcs.net:443/media/xst/2023/31-4/xst-31-4-xst221349/xst-31-xst221349-g004.jpg)
3.4Performances of Rad-score, radiomics nomogram, and clinical model
The radiomics nomogram yielded AUCs of 0.906 (95% CI, 0.840–0.966) and 0.790 (95% CI, 0.554–0.952) in the training and test sets, respectively (Fig. 5). The results showed that the radiomics nomogram has favorable predictive performances. The AUCs of the Rad-score and clinical model were 0.873 (95% CI, 0.808–0.948) and 0.694 (95% CI, 0.581–0.782) in the training set and 0.700 (95% CI, 0.506–0.911) and 0.759 (95% CI, 0.617–0.870) in the test set, respectively. The diagnostic performances of the three models are shown in Table 3. The results revealed that the radiomics nomogram’ performance was better than Rad-score and clinical model in the training and test sets. The average AUC and standard deviation (STD) of the nomogram after repeating training/testing process 6 times are shown in Fig. 6. The results showed a mean AUC of 0.943 and 0.785, and a STD of 0.027 and 0.038, respectively, for the nomogram in the training and test sets. The nomogram was experimentally shown to be robustness.
Fig. 5
Receiver operating characteristic (ROC) curves of Rad-score, clinical model and radiomics nomogram in the training (a) and validation (b) cohorts.
![Receiver operating characteristic (ROC) curves of Rad-score, clinical model and radiomics nomogram in the training (a) and validation (b) cohorts.](https://ip.ios.semcs.net:443/media/xst/2023/31-4/xst-31-4-xst221349/xst-31-xst221349-g005.jpg)
Table 3
Predictive performances of the three models
AUC | Sensitivity | Specificity | Accuracy | ||
Rad-score | Training set | 0.873 | 0.857 | 0.787 | 0.805 |
Test set | 0.700 | 0.556 | 0.889 | 0.806 | |
Clinical model | Training set | 0.694 | 0.667 | 0.721 | 0.707 |
Test set | 0.759 | 0.889 | 0.630 | 0.694 | |
Radiomics nomogram | Training set | 0.906 | 0.905 | 0.836 | 0.854 |
Test set | 0.790 | 0.667 | 0.926 | 0.861 |
Fig. 6
Receiver operating characteristic (ROC) curves of the nomogram after repeating training/testing process 6 times in the training (a) and test (b) sets.
![Receiver operating characteristic (ROC) curves of the nomogram after repeating training/testing process 6 times in the training (a) and test (b) sets.](https://ip.ios.semcs.net:443/media/xst/2023/31-4/xst-31-4-xst221349/xst-31-xst221349-g006.jpg)
DCA showed that the radiomics nomogram had net benefit than the “treat all” or “treat none” scheme, whereas the threshold probability ranged from 0 to 0.65 in the test set (Fig. 7). The calibration curves of the radiomics nomogram demonstrated good consistency between predictive outcome and observation in the training and test sets (Fig. 8).
Fig. 7
Decision curve analysis of three models in validation set. The y-axis measures the net benefit. The green line represents the radiomics nomogram. The red line represents the radiomics score. The blue line represents the clinical model. The black line represents the assumption that all patients achieve the PCR after NAC. The horizontal red thin line represents the assumption that no patients reach the PCR after NAC.
![Decision curve analysis of three models in validation set. The y-axis measures the net benefit. The green line represents the radiomics nomogram. The red line represents the radiomics score. The blue line represents the clinical model. The black line represents the assumption that all patients achieve the PCR after NAC. The horizontal red thin line represents the assumption that no patients reach the PCR after NAC.](https://ip.ios.semcs.net:443/media/xst/2023/31-4/xst-31-4-xst221349/xst-31-xst221349-g007.jpg)
Fig. 8
Calibration curves of radiomics nomogram in the training (a) and validation (b) sets. The diagonal line represents the perfect prediction of the radiomics nomogram. The red, blue and green lines represent the calibration curve of rad-score, clinical model, and radiomics nomogram, respectively. The calibration curves of radiomics nomogram are close to the diagonal line both in the training and validation sets, which shows that the prediction probability have good agreement with the actual probability.
![Calibration curves of radiomics nomogram in the training (a) and validation (b) sets. The diagonal line represents the perfect prediction of the radiomics nomogram. The red, blue and green lines represent the calibration curve of rad-score, clinical model, and radiomics nomogram, respectively. The calibration curves of radiomics nomogram are close to the diagonal line both in the training and validation sets, which shows that the prediction probability have good agreement with the actual probability.](https://ip.ios.semcs.net:443/media/xst/2023/31-4/xst-31-4-xst221349/xst-31-xst221349-g008.jpg)
4Discussion
A CESM-based radiomics nomogram was constructed and validated for pCR prediction in patients with locally advanced breast cancer before NAC. The result showed the nomogram’s good prediction efficiency (AUC = 0.79) in the test set. The noninvasive tool combining radiomics with PR could predict pCR in patients with breast cancer who undergo NAC. It has good clinical application prospects. As far as we know, no report has investigated the feasibility of using a CESM-based radiomics nomogram in breast cancer to predict pCR after NAC.
The radiomics nomogram can obtain features that are invisible to the naked eye from tumor images and can more accurately describe the features of breast tumors [28]. In the present study, the radiomics nomogram had better predictive performance than Rad-score and clinical prognostic factors (PR). The radiomics nomogram had higher specificity and accuracy than Rad-score and PR (92.6% vs 88.9% vs 63%; 86.1% vs 80.6% vs 69.4%). Wang et al. [19] investigated the feasibility of using a CESM-based radiomics nomogram in breast cancer to predict NAC-insensitive patients. The results showed that the radiomics nomogram combined with Rad-score and clinical prognostic factors (Ki67, Her2, and BPE) has the best predictive performance. The present study and Wang et al.’s study showed that CESM-based radiomics can provide certain value in the prediction of NAC efficacy in breast cancer. However, the purpose of our study is different. Wang et al. studied the sensitivity to NAC in breast cancer, whereas the current study investigated the pCR of patients under NAC. The effective prediction of pCR to NAC in breast cancer can assist clinicians in judging the prognosis of patients and help doctors determine whether patients with triple-negative and HER2 overexpression need intensive treatment after chemotherapy.
However, many MRI and positron emission tomography/computed tomography (PET/CT) studies have been applied in pCR prediction [29–31]. Fangberget et al. assessed the value of MRI in predicting pCR through changes in tumor size and tumor apparent diffusion coefficient (ADC) during treatment [31]. They predicted pCR with sensitivity values of 88% and 80% and specificity values of 91% and 80% using ADC and tumor volume reduction, respectively. In comparison, the present research developed and validated a CESM-based radiomics model with a larger sample size (118 vs 31) and higher specificity (92.6% vs 80%). The meta-analysis of Yuan et al. of 25 studies showed that the sensitivity and specificity of MRI in predicting pCR after NAC are 63% (range 56% –70%) and 91% (range 89% –92%), respectively [32]. In comparison, the proposed model had a sensitivity and a specificity of 66.7% and 92.6%, respectively. The results showed that the CESM-based radiomics model could predict pCR with higher specificity and sensitivity than other models. Thus, the proposed radiomics model can be used as a supplement for MRI to predict pCR after NAC in patients with breast cancer, especially those who are not able to undergo MRI, such as patients with claustrophobia. In addition, Antunovic et al. assessed the role of the radiomics parameters of PET/CT in predicting pCR after NAC in patients with locally advanced breast cancer and built four radiomics models [29]. The AUCs of the four radiomics models are in the range of 0.70–0.73. In our current research, the radiomics model’s AUC is 0.79, and more cases were included (118 vs 79). Furthermore, PET/CT is expensive, poorly accepted by patients, and cannot be popularized. Therefore, the CESM-based radiomics nomogram for breast cancer has a good prospect of clinical application.
Our study still has some limitations. One of the major drawbacks is the small sample size and its single-center retrospective design. In addition, CESM is a relatively new examination item. We also required the inclusion criteria to meet the corresponding clinical indicators, such as breast tumor examination, which made the inclusion limited. Although previous studies have shown that different molecular subtypes can obtain different rates of pCR [33, 34], the present study showed that molecular subtypes did not improve the performance of the radiomics model, which may be caused by the small sample size and sample distribution. Therefore, a larger sample size and a multimodal study are needed to improve the prediction efficiency of the model to continue our study. Second, the ROI was manually sketched, although ICCs were used to assess the reproducibility of the radiomics feature extraction and increase the confidence. In the future, deep learning will be added to improve the agreement of image segmentation. Third, the characteristics of the peritumoral region was not included. A related study [35] showed that the peritumoral region is related to pCR; therefore, it has potential research value in CESM. This factor is also one of our future research directions. Furthermore, this study is a CESM-based radiomics study. Radiomics features are manually set in advance. However, deep learning can automatically mine the deep information of the image according to different tasks. In the future study, a larger sample data will be used to explore the value of CESM-based deep learning model in predicting pCR after NAC in breast cancer.
This study is the first to develop a CESM-based radiomics nomogram for locally advanced breast cancer pCR prediction. Although CESM as a new diagnostic imaging modality has fewer studies than MRI, traditional mammography, PET/CT, and ultrasound studies, its clinical application value and prospect are undeniable. Our group has already achieved some encouraging outcomes using CESM-based radiomics methods [18, 19, 21, 22].
5Conclusion
In conclusion, the radiomics model based on CESM images showed acceptable predictive performance in predicting pCR after NAC in breast cancer, which can potentially benefit for those patients who have not responded well to NAC. Further research on larger sample size with more centers and integration with deep learning methods is needed in the future.
Declarations
Ethics approval and consent to participate
This study was approved by the institutional review board of Yantai Yuhuangding Hospital, and the patients’ right to informed consent was waived.
Consent for publication
Consent forms were obtained.
Availability of data and material
The datasets generated and/or analysed during the current study are not publicly available due confidential information but are available from the corresponding author on reasonable request.
Competing interests
The authors declare that they have no competing interests.
Funding
This work is supported by Yantai Science and Technology Innovation Development Plan (2022YD029), the National Natural Science Foundation of China (82001775), the Natural Science Foundation of Shandong Province of China (ZR2021MH120) and the Special Fund for Breast Disease Research of Shandong Medical Association (YXH2021ZX055).
Authors’ contributions
Kun Zhang contributed to the conception of the study; Guangdong Qiao and Ning Mao contributed significantly to analysis and manuscript preparation; Kun Zhang performed the data analyses and wrote the manuscript; Jun Lin, Fan Lin, Zhongyi Wang, Haicheng Zhang and Shijie Zhang helped perform the analysis with constructive discussions.
Acknowledgments
Not applicable.
References
[1] | Korde L.A. , et al., Neoadjuvant Chemotherapy, Endocrine Therapy, and Targeted Therapy for Breast Cancer: ASCO Guideline, J Clin Oncol 39: (13) ((2021) ), 1485–1505. |
[2] | Thompson A.M. , Moulder-Thompson S.L. , Neoadjuvant treatment of breast cancer, Ann Oncol 23: (Suppl 10) ((2012) ), x231–236. |
[3] | Edge S.B. , Compton C.C. , The American Joint Committee on Cancer: the 7th edition of the AJCC cancer staging manual and the future of TNM, Ann Surg Oncol 17: (6) ((2010) ), 1471–1474. |
[4] | Luangdilok S. , Samarnthai N. , Korphaisarn K. , Association between Pathological Complete Response and Outcome Following Neoadjuvant Chemotherapy in Locally Advanced Breast Cancer Patients, J Breast Cancer 17: (4) ((2014) ), 376–385. |
[5] | Kong X. , Moran M.S. , Zhang N. , et al., Meta-analysis confirms achieving pathological complete response after neoadjuvant chemotherapy predicts favourable prognosis for breast cancer patients, Eur J Cancer 47: (14) ((2011) ), 2084–2090. |
[6] | Earl H. , Provenzano E. , Abraham J. , et al., Neoadjuvant trials in early breast cancer: pathological response at surgery and correlation to longer term outcomes - what does it all mean? BMC Med 13: ((2015) ), 234. |
[7] | Michishita S. , Kim S.J. , Shimazu K. , et al., Prediction of pathological complete response to neoadjuvant chemotherapy by magnetic resonance imaging in breast cancer patients, The Breast 24: (2) ((2015) ), 159–165. |
[8] | Fukuda T. , Horii R. , Gomi N. , et al., Accuracy of magnetic resonance imaging for predicting pathological complete response of breast cancer after neoadjuvant chemotherapy: association with breast cancer subtype, SpringerPlus 5: (1), 2016. |
[9] | Tahmassebi A. , Wengert G.J. , Helbich T.H. , et al., Impact of Machine Learning With Multiparametric Magnetic Resonance Imaging of the Breast for Early Prediction of Response to Neoadjuvant Chemotherapy and Survival Outcomes in Breast Cancer Patients, Investigative Radiology 54: (2) ((2019) ), 110–117. |
[10] | Greenwood H.I. , Abbreviated protocol breast MRI: The past, present, and future, Clin Imaging 53: ((2019) ), 169–173. |
[11] | Houssami N. , Ciatto S. , Macaskill P. , et al., Accuracy and surgical impact of magnetic resonance imaging in breast cancer staging: systematic review and meta-analysis in detection of multifocal and multicentric cancer, J Clin Oncol 26: (19) ((2008) ), 3248–3258. |
[12] | Berg W.A. , Blume J.D. , Adams A.M. , et al., Reasons women at elevated risk of breast cancer refuse breast MR imaging screening: ACRIN, Radiology 254: (1) ((2010) ), 79–87. |
[13] | James J.J. , Tennant S.L. , Contrast-enhanced spectral mammography (CESM), Clin Radiol 73: (8) ((2018) ), 715–723. |
[14] | Jochelson M.S. , Dershaw D.D. , Sung J.S. , et al., Bilateral contrast-enhanced dual-energy digital mammography: feasibility and comparison with conventional digital mammography and MR imaging in women with known breast carcinoma, Radiology 266: (3) ((2013) ), 743–751. |
[15] | Bi W.L. , Hosny A. , Schabath M.B. , et al., Artificial intelligence in cancer imaging: Clinical challenges and applications, CA Cancer J Clin 69: (2) ((2019) ), 127–157. |
[16] | Chen X. , Chen X. , Yang J. , et al., Combining Dynamic Contrast-Enhanced Magnetic Resonance Imaging and Apparent Diffusion Coefficient Maps for a Radiomics Nomogram to Predict Pathological Complete Response to Neoadjuvant Chemotherapy in Breast Cancer Patients, Journal of Computer Assisted Tomography 44: (2) ((2020) ), 275–283. |
[17] | Tsukada H. , Tsukada J. , Schrading S. , et al., Accuracy of multi-parametric breast MR imaging for predicting pathological complete response of operable breast cancer prior to neoadjuvant systemic therapy, Magnetic Resonance Imaging 62: ((2019) ), 242–248. |
[18] | Mao N. , Yin P. , Li Q. , et al., Radiomics nomogram of contrast-enhanced spectral mammography for prediction of axillary lymph node metastasis in breast cancer: a multicenter study, Eur Radiol 30: (12) ((2020) ), 6732–6739. |
[19] | Wang Z. , Lin F. , Ma H. , et al., Contrast-enhanced spectral mammography-based radiomics nomogram for the prediction of neoadjuvant chemotherapy-insensitive breast cancers, Front Oncol 11: ((2021) ), 605230. |
[20] | Mao N. , Jiao Z. , Duan S. , et al., Preoperative prediction of histologic grade in invasive breast cancer by using contrast-enhanced spectral mammography-based radiomics, J Xray Sci Technol 29: (5) ((2021) ), 763–772. |
[21] | Lin F. , Wang Z. , Zhang K. , et al., Contrast-Enhanced Spectral Mammography-Based Radiomics Nomogram for Identifying Benign and Malignant Breast Lesions of Sub-1 cm, Front Oncol 10: ((2020) ), 573630. |
[22] | Mao N. , et al., Intratumoral and peritumoral radiomics for preoperative prediction of neoadjuvant chemotherapy effect in breast cancer based on contrast-enhanced spectral mammography, Eur Radiol 32: (5) ((2022) ), 3207–3219. |
[23] | Fujii T. , Kogawa T. , Dong W. , et al., Revisiting the definition of estrogen receptor positivity in HER2-negative primary breast cancer, Ann Oncol 28: (10) ((2017) ), 2420–2428. |
[24] | Allison K.H. , Hammond M.E.H. , Dowsett M. , et al., Estrogen and Progesterone Receptor Testing in Breast Cancer: ASCO/CAP Guideline Update, J Clin Oncol 38: (12) ((2020) ), 1346–1366. |
[25] | Collewet G. , Strzelecki M. , Mariette F. , Influence of MRI acquisition protocols and image intensity normalization methods on texture classification, Magn Reson Imaging 22: (1) ((2004) ), 81–91. |
[26] | Gibbs P. , Turnbull L.W. , Textural analysis of contrast-enhanced MR images of the breast, Magn Reson Med 50: (1) ((2003) ), 92–98. |
[27] | Depeursinge A. , Foncubierta-Rodriguez A. , Van D. , De Ville and H. Muller, Three-dimensional solid texture analysis in biomedical imaging: review and opportunities, Med Image Anal 18: (1) ((2014) ), 176–196. |
[28] | Aerts H.J. , The Potential of Radiomic-Based Phenotyping in Precision Medicine: A Review, JAMA Oncol 2: (12) ((2016) ), 1636–1642. |
[29] | Antunovic L. , De R. , Sanctis, L. Cozzi, et al., PET/CT radiomics in breast cancer: promising tool for prediction of pathological response to neoadjuvant chemotherapy, Eur J Nucl Med Mol Imaging 46: (7) ((2019) ), 1468–1477. |
[30] | Park S.H. , Moon W.K. , Cho N. , et al., Comparison of diffusion-weighted MR imaging and FDG PET/CT to predict pathological complete response to neoadjuvant chemotherapy in patients with breast cancer, Eur Radiol 22: (1) ((2012) ), 18–25. |
[31] | Fangberget A. , Nilsen L.B. , Hole K.H. , et al., Neoadjuvant chemotherapy in breast cancer-response evaluation and prediction of response to treatment using dynamic contrast-enhanced and diffusion-weighted MR imaging, Eur Radiol 21: (6) ((2011) ), 1188–1199. |
[32] | Yuan Y. , Chen X-S. , Liu S-Y. , Shen K-W. , Accuracy of MRI in Prediction of Pathologic Complete Remission in Breast Cancer After Preoperative Therapy: A Meta-Analysis, American Journal of Roentgenology 195: (1) ((2010) ), 260–268. |
[33] | von G. , Minckwitz, M. Untch, J.U. Blohmer, et al., Definition and impact of pathologic complete response on prognosis after neoadjuvant chemotherapy in various intrinsic breast cancer subtypes, J Clin Oncol 30: (15) ((2012) ), 1796–1804. |
[34] | Cortazar P. , Zhang L. , Untch M. , et al., Pathological complete response and long-term clinical benefit in breast cancer: the CTNeoBC pooled analysis, The Lancet 384: (9938) ((2014) ), 164–172. |
[35] | Braman N.M. , Etesami M. , Prasanna P. , et al., Intratumoral and peritumoral radiomics for the pretreatment prediction of pathological complete response to neoadjuvant chemotherapy based on breast DCE-MRI, Breast Cancer Research 19: ((2017) ), 57. |