Affiliations: Department of Computer Science, School of Applied Statistics, National Institute of Development Adminstration (NIDA), Bangkok 10240, Thailand
Abstract: In this paper, a prototype-based supervised clustering algorithm is proposed. The proposed algorithm, called the Supervised Growing Neural Gas algorithm (SGNG), incorporates several techniques from some unsupervised GNG algorithms such as the adaptive learning rates and the cluster repulsion mechanisms of the Robust Growing Neural Gas algorithm, and the Type Two Learning Vector Quantization (LVQ2) technique. Furthermore, a new prototype insertion mechanism and a clustering validity index are proposed. These techniques are designed to utilize class labels of the training data to guide the clustering. The SGNG algorithm is capable of clustering adjacent regions of data objects labeled with different classes, formulating topological relationships among prototypes, and automatically determining the optimal number of clusters using the proposed validity index. To evaluate effectiveness of the SGNG algorithm, two experiments are conducted. The first experiment uses two synthetic data sets to illustrate graphically the potential with respect to growing ability, ability to cluster adjacent regions of different classes, and ability to determine the optimal number of prototypes. The second experiment evaluates the effectiveness using UCI benchmark data sets. The results from the second experiment show that the SGNG algorithm performs better than other supervised clustering algorithms, for both cluster impurities and total running times.
