Affiliations: [a]
School of Software, Northwestern Polytechnical University, Xi’an City, Shaanxi Province, China
| [b]
Debbie and Jerry Ivy College of Business, Iowa State University, Iowa, USA
| [c]
School of Management, Northwestern Polytechnical University, Xi’an City, Shaanxi Province, China
Correspondence:
[*]
Corresponding author. Kuiyu Zhu, School of Software, Northwestern Polytechnical University, Xi’an City, Postal code 710129, Shaanxi Province, China. E-mail: zhuky@mail.nwpu.edu.cn.
Note: [1] Author Ming Yin and Kuiyu Zhu contributed equally to this
work.
Abstract: Effectively identifying self-admitted technical debt (SATD) from project source code comments helps developers quickly find and repay these debts, thereby reducing its negative impact. Previous studies used techniques based on patterns, text mining, natural language processing, and neural networks to detect SATD. Compared with these above, Convolutional Neural Networks (CNN) have the strong feature extraction ability. Deep network ensembles are demonstrated great potential for the task of sentences classification. In order to boost the performance of CNN-based SATD detecting, we propose a deep neural network ensemble contribute to ensemble learning in a simple yet effective way. Specifically, CNN, CNN-LSTM (convolutional neural network and long short-term memory), and DPCNN (Deep Pyramid Convolutional Neural Networks) are used as individual classifiers to diversify the deep network ensembles. In order to improve the explainability, we introduce attention to measure the contribution of feature words to SATD classification. 62,285 source code comments from 10 projects were used in our experiments. The results show that our approach can effectively reduce misjudgment and detect more SATD, especially for cross-project, so as to greatly improve the detection accuracy.
