Affiliations: [a] Graduate School of Information Science and Technology, Osaka University, Osaka, Japan | [b] Graduate School of Science and Engineering, Kagoshima University, Kagoshima, Japan | [c] The Institute of Scientific and Industrial Research, Osaka University, Osaka, Japan
Correspondence:
[*]
Corresponding author: Wasin Kalintha, Graduate School of Information Science and Technology, Osaka University, 8-1 Mihogaoka, Ibaraki, Osaka, 567-0047, Japan. Tel.: +81 6 6879 8426; Fax: +81 6 6879 8428; E-mail: wasin@ai.sanken.osaka-u.ac.jp.
Abstract: This study proposes a novel distance metric learning method called evolutionary distance metric learning (EDML) to improve clustering quality that simultaneously evaluates inter- and intra-clusters. While we also provide an extension which integrates kernelization technique to the proposed method namely kernelized evolutionary distance metric learning (K-EDML). Hence, the non-linear transformation of distance metric can be performed while maintaining all properties of EDML. The proposed methods are able to handle either class label or pairwise constraints and directly improve any clustering index as an objective function. Both can be viewed as utilization of cluster-level soft constraints, unlike other instance-level hard constraints which sometimes collapse the clustering. Also, maintaining neighbor relation of clusters can lead to better visualization of the clustering result. For multimodality problem of the objective function, an evolutionary algorithm (EA), differential evolution with self-adapting control parameters and generalized opposition-based learning (GOjDE), is employed to optimize a metric transform matrix based on the Mahalanobis distance. We empirically demonstrate the drawback of EDML in non-linearly separable input space and illustrate the benefit of kernel function to extension K-EDML method by showing its superior result benefits to other clustering algorithms in the semi-supervised clustering on various real-world datasets.
