Deep CNN models for pulmonary nodule classification: Model modification, model integration, and transfer learning

Article type: Research Article

Authors: Zhao, Xinzhuo^{a; b} | Qi, Shouliang^{a; c; *} | Zhang, Baihua^a | Ma, He^a | Qian, Wei^{a; d} | Yao, Yudong^{a; e} | Sun, Jianjun^b

Affiliations: [a] Sino-Dutch Biomedical and Information Engineering School, Northeastern University, Shenyang, China | [b] Border Biomedical Research Center, University of Texas at El Paso, El Paso, USA | [c] Neusoft Research of Intelligent Healthcare Technology, Co. Ltd., Shenyang, China | [d] College of Engineering, University of Texas at El Paso, El Paso, USA | [e] Electrical and Computer Engineering, Stevens Institute of Technology, USA

Correspondence: [*] Corresponding author: Shouliang Qi, Sino-Dutch Biomedical and Information Engineering School, Northeastern University, No. 195 Chuangxin Avenue, Hunnan District, Shenyang, 110169, China; E-mail: qisl@bmie.neu.edu.cn.

Abstract: BACKGROUND:Deep learning has made spectacular achievements in analysing natural images, but it faces challenges for medical applications partly due to inadequate images. OBJECTIVE:Aiming to classify malignant and benign pulmonary nodules using CT images, we explore different strategies to utilize the state-of-the-art deep convolutional neural networks (CNN). METHODS:Experiments are conducted using the Lung Image Database Consortium image collection (LIDC-IDRI), which is a public database containing 1018 cases. Three strategies are implemented including to 1) modify some state-of-the-art CNN architectures, 2) integrate different CNNs and 3) adopt transfer learning. Totally, 11 deep CNN models are compared using the same dataset. RESULTS:Study demonstrates that, for the model modification scheme, a concise CifarNet performs better than the other modified CNNs with more complex architectures, achieving an area under ROC curve of AUC = 0.90. Integrated CNN models do not significantly improve the classification performance, but the model complexity is reduced. Transfer learning outperforms the other two schemes and ResNet with fine-tuning leads to the best performance with an AUC = 0.94, as well as the sensitivity of 91% and an overall accuracy of 88%. CONCLUSIONS:Model modification, model integration, and transfer learning can play important roles to identify and generate optimal deep CNN models in classifying pulmonary nodules based on CT images efficiently. Transfer learning is preferred when applying deep learning to medical imaging applications.

Keywords: Convolutional neural networks, deep learning, lung cancer, nodule classification, transfer learning

DOI: 10.3233/XST-180490

Journal: Journal of X-Ray Science and Technology, vol. 27, no. 4, pp. 615-629, 2019