Improved algorithm of Context Graph based on feature selection

Article type: Research Article

Authors: Liu, Wei | Zhao, Jian^* | Yang, Yongji

Affiliations: College of Computer Science and Technology, Changchun University, Changchun, Jilin, China

Correspondence: [*] Corresponding author: Zhao Jian, College of Computer Science and Technology, Changchun University, Changchun, Jilin, China. E-mail: Zhaojian@ccu.edu.cn.

Abstract: In order to solve the problem of low efficiency of traditional theme crawlers in searching theme pages, the crawling algorithm based on Context Graph was discussed. After analyzing the working principle and process of the algorithm, we introduced a new algorithm idea named feature selection algorithm. This new algorithm improved the original TF-IDF formula accordingly and solved the algorithm problems.

Keywords: Context Graph, feature selection, theme crawler, DF-IDF

DOI: 10.3233/JCM-194169

Journal: Journal of Computational Methods in Sciences and Engineering, vol. 20, no. 4, pp. 1043-1051, 2020