RIONA: A New Classification System Combining Rule Induction and Instance-Based Learning

Article type: Research Article

Authors: Góra, Grzegorz | Wojna, Arkadiusz

Affiliations: Institute of Informatics, Warsaw University, ul. Banacha 2, 02-097 Warszawa, Poland

Abstract: The article describes a method combining two widely-used empirical approaches to learning from examples: rule induction and instance-based learning. In our algorithm (RIONA) decision is predicted not on the basis of the whole support set of all rules matching a test case, but the support set restricted to a neighbourhood of a test case. The size of the optimal neighbourhood is automatically induced during the learning phase. The empirical study shows the interesting fact that it is enough to consider a small neighbourhood to achieve classification accuracy comparable to an algorithm considering the whole learning set. The combination of k-NN and a rule-based algorithm results in a significant acceleration of the algorithm using all minimal rules. Moreover, the presented classifier has high accuracy for both kinds of domains: more suitable for k-NN classifiers and more suitable for rule based classifiers.

Keywords: machine learning, instance-based learning, rule induction, nearest neighbour method

Journal: Fundamenta Informaticae, vol. 51, no. 4, pp. 369-390, 2002