Comparison of similarity measures for clustering Turkish documents

Article type: Research Article

Authors: Madylova, Ainura^{; *} | Gündüz Öğüdücü, Şule

Affiliations: Department of Computer Engineering, Istanbul Technical University, Maslak, Istanbul TR34469, Turkey

Correspondence: [*] Corresponding author. Tel.: +90 212 2853682; Fax: +90 212 2853679; E-mail: madylova@itu.edu.tr.

Abstract: Text clustering has become an important part of the web data organization with the rapid growth of the World Wide Web (www). Clustering simplifies web search engine work by grouping large amount of documents, retrieved according to a given query. Similarity measures used in clustering affect the output of the grouping directly. Most of the document clustering techniques rely on single term analysis of text, such as vector space model. In order to improve grouping of Turkish documents, we investigate several similarity measures based on the semantic similarity of terms. Moreover, some techniques for calculating documents similarity are studied. The aim of this paper is to study the effects of semantic and single term similarity measures to the clustering results of Turkish documents. All experiments are carried out on Turkish web sites, taking into account the relationships of terms based on the ontology for the Turkish language.

Keywords: Semantic similarity, single term similarity, clustering of web documents

DOI: 10.3233/IDA-2009-0394

Journal: Intelligent Data Analysis, vol. 13, no. 5, pp. 815-832, 2009