Affiliations: [a] Graduate School of Informatics, Kyoto University, Yoshida Honmachi, Sakyo-ku, Kyoto, Japan | [b] Japan Society for the Promotion of Science, Japan
Correspondence:
[*]
Corresponding author: Mahito Sugiyama, Graduate School of Informatics, Kyoto University, Yoshida Honmachi, Sakyo-ku, 606-8501 Kyoto, Japan. Tel.: +81 75 753 5628; Fax: +81 75 753 5628; E-mail: mahito@iip.ist.i.kyoto-u.ac.jp; Present address: Max Planck Institute for Intelligent Systems, AG K. Borgwardt, Spemannstr. 38, 72076, Tübingen, Germany. Tel.: +49 7071 601 1789; E-mail: mahito.sugiyama@tuebingen.mpg.de.
Abstract: We propose a new approach for semi-supervised learning using closed set lattices, which have been recently used for frequent pattern mining within the framework of the data analysis technique of Formal Concept Analysis (FCA). We present a learning algorithm, called SELF (SEmi-supervised Learning via FCA), which performs as a multiclass classifier and a label ranker for mixed-type data containing both discrete and continuous variables, while only few learning algorithms such as the decision tree-based classifier can directly handle mixed-type data. From both labeled and unlabeled data, SELF constructs a closed set lattice, which is a partially ordered set of data clusters with respect to subset inclusion, via FCA together with discretizing continuous variables, followed by learning classification rules through finding maximal clusters on the lattice. Moreover, it can weight each classification rule using the lattice, which gives a partial order of preference over class labels. We illustrate experimentally the competitive performance of SELF in classification and ranking compared to other learning algorithms using UCI datasets.
