Comparing two genetic overproduce-and-choose strategies for fuzzy rule-based multiclassification systems generated by bagging and mutual information-based feature selection
Issue title: Hybrid Fuzzy Models
Guest editors: José M. Benítezx, Salvador Garcíay, Santi Caballéz and Ángel Alejandro Juanz
Affiliations: European Centre for Soft Computing, Edificio Científico-Tecnológico, planta 3. Gonzalo Gutiérrez Quirós, s/n, 33600 - Mieres (Asturias), Spain | [x] Department of Computer Science and Artificial Intelligence, Universidad de Granada, Granada, Spain | [y] Department of Computer Science, University of Jaén, Jaén, Spain | [z] Open University of Catalonia, Barecelona, Spain
Note: [1] This work has been supported by the Spanish Ministry of
Education and Science, under grants TIN2005-08036-C05-05 and
TIN2006-00829.
Abstract: In [14] we proposed a scheme to generate fuzzy rule-based multiclassification systems by means of bagging, mutual information-based feature selection, and a multicriteria genetic algorithm for static component classifier selection guided by the ensemble training error. In the current contribution we extend the latter component by making use of the bagging approach's capability to evaluate the accuracy of the classifier ensemble using the out-of-bag estimates. An exhaustive study is developed on the potential of the two multicriteria genetic algorithms respectively considering the classical training error and the out-of-bag error fitness functions to design a final multiclassifier with an appropriate accuracy-complexity trade-off. Several parameter settings for the global approach are tested when applied to nine popular UCI datasets with different dimensionality.
