Affiliations: [a] Data Engineering Lab, Indian Institute of Information Technology and Management – Kerala, Thiruvananthapuram, India | [b] School of Electronics, Electrical Engineering and Computer Science, Queen’s University Belfast, UK | [c] Kerala University of Digital Sciences, Innovation and Technology, Thiruvananthapuram, India
Correspondence:
[*]
Corresponding author: V.S. Anoop, Data Engineering Lab, Indian Institute of Information Technology and Management – Kerala (IIITM-K), Thiruvananthapuram, India. E-mail: anoop.res15@iiitmk.ac.in.
Abstract: Online social networks are considered to be one of the most disruptive platforms where people communicate with each other on any topic ranging from funny cat videos to cancer support. The widespread diffusion of mobile platforms such as smart-phones causes the number of messages shared in such platforms to grow heavily, thus more intelligent and scalable algorithms are needed for efficient extraction of useful information. This paper proposes a method for retrieving relevant information from social network messages using a distributional semantics-based framework powered by topic modeling. The proposed framework combines the Latent Dirichlet Allocation and distributional representation of phrases (Phrase2Vec) for effective information retrieval from online social networks. Extensive and systematic experiments on messages collected from Twitter (tweets) show this approach outperforms some state-of-the-art approaches in terms of precision and accuracy and better information retrieval is possible using the proposed method.
Keywords: Social networks, distributional semantics, information retrieval, topic modeling, Phrase2Vec, latent dirichlet allocation
