Sequential patterns for text categorization

Article type: Research Article

Authors: Jaillet, S. | Laurent, A. | Teisseire, M.

Affiliations: LIRMM-CNRS – Université Montpellier 2, 161 rue Ada, 34392 Montpellier Cedex 5 France. E-mail: jaillet@lirmm.fr, laurent@lirmm.fr, teisseire@lirmm.fr

Abstract: Text categorization is a well-known task based essentially on statistical approaches using neural networks, Support Vector Machines and other machine learning algorithms. Texts are generally considered as bags of words without any order. Although these approaches have proven to be efficient, they do not provide users with comprehensive and reusable rules about their data. Such rules are, however, very important for users to describe trends in the data they have to analyze. In this framework, an association-rule based approach has been proposed by Bing Liu (CBA). We propose, in this paper, to extend this approach by using sequential patterns in the SPaC method (Sequential Patterns for Classification) for text categorization. Taking order into account allows us to represent the succession of words through a document without complex and time-consuming representations and treatments such as those performed in natural language and grammatical methods. The original method we propose here consists in mining sequential patterns in order to build a classifier. We experimentally show that our proposal is relevant, and that it is very interesting compared to other methods. In particular, our method outperforms CBA and provides better results than SVM on some corpus.

Keywords: Text mining, categorization, sequential patterns, SPaC

DOI: 10.3233/IDA-2006-10302

Journal: Intelligent Data Analysis, vol. 10, no. 3, pp. 199-214, 2006