Robust mixture model-based clustering with genetic algorithm approach

Article type: Research Article

Authors: Thang, Nguyen Duc | Chen, Lihui^{; *} | Chan, Chee Keong

Affiliations: Division of Information Engineering, School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore

Correspondence: [*] Corresponding author. Tel.: +65 67904484; Fax: +65 67933318; E-mail: elhchen@ntu.edu.sg.

Abstract: In this paper, we address the robustness issue of maximum likelihood based methods in data clustering. Probabilistic mixture model has been a well known approach to cluster analysis. However, as they rely on maximum likelihood estimation (MLE), the algorithms are often very sensitive to noise and outliers. In this work, we implement a variant of the classical mixture model-based clustering (M2C) following a proposed general framework for handling outliers. Genetic Algorithm (GA) is incorporated into the framework to produce a novel algorithm called GA-based Partial M2C (GA-PM2C). Analytical and experimental studies show that GA-PM2C can overcome the negative impact of outliers in data clustering, hence provides highly accurate and reliable clustering results. It also exhibits excellent consistency in performance and low sensitivity to initializations.

Keywords: Clustering, robust clustering, outliers, maximum likelihood, EM algorithm, mixture model, genetic algorithm

DOI: 10.3233/IDA-2010-0472

Journal: Intelligent Data Analysis, vol. 15, no. 3, pp. 357-373, 2011