Searching for just a few words should be enough to get started. If you need to make more complex queries, use the tips below to guide you.
Article type: Research Article
Authors: Anoop, V.S.a; * | Asharaf, S.b
Affiliations: [a] Data Engineering Lab, Indian Institute of Information Technology and Management, Kerala, Thiruvananthapuram, India | [b] Indian Institute of Information Technology and Management, Kerala, Thiruvananthapuram, India
Correspondence: [*] Corresponding author: V.S. Anoop, Data Engineering Lab, Indian Institute of Information Technology and Management, Kerala (IIITM-K), Thiruvananthapuram, Kerala, India. E-mail: anoop.res15@iiitmk.ac.in.
Abstract: A vast majority of text mining and machine learning algorithms such as topic models, classification, clustering are based on statistical methods thus the semantics or meaning of the words or phrases are not considered. Interpretation of outputs generated by such algorithms are difficult for humans because of the absence of sufficient contextual information. Distributional semantics is a relatively new but active research area in natural language processing that quantifies semantic similarities between linguistic elements considering the context in which they occur. Conceptualization algorithms on the other hand enriches short text such as words and phrases. This paper proposes an approach that uses a map-reduce framework for combining these two techniques to generate conceptualized semantic clusters of phrases using distributional representation. Rigorous and systematic experiments on unstructured text datasets show that this approach can generate semantically rich and human interpretable concept clusters from large datasets. Further, the approach is scalable when dealing with high dimensional data since this method uses a map-reduce based framework for clustering.
Keywords: Distributional semantics, concept extraction, semantic clustering, map-reduce, text mining
DOI: 10.3233/IDT-180089
Journal: Intelligent Decision Technologies, vol. 13, no. 2, pp. 153-160, 2019
IOS Press, Inc.
6751 Tepper Drive
Clifton, VA 20124
USA
Tel: +1 703 830 6300
Fax: +1 703 830 2300
sales@iospress.com
For editorial issues, like the status of your submitted paper or proposals, write to editorial@iospress.nl
IOS Press
Nieuwe Hemweg 6B
1013 BG Amsterdam
The Netherlands
Tel: +31 20 688 3355
Fax: +31 20 687 0091
info@iospress.nl
For editorial issues, permissions, book requests, submissions and proceedings, contact the Amsterdam office info@iospress.nl
Inspirees International (China Office)
Ciyunsi Beili 207(CapitaLand), Bld 1, 7-901
100025, Beijing
China
Free service line: 400 661 8717
Fax: +86 10 8446 7947
china@iospress.cn
For editorial issues, like the status of your submitted paper or proposals, write to editorial@iospress.nl
如果您在出版方面需要帮助或有任何建, 件至: editorial@iospress.nl