Evolving Neural Network Ensembles by Minimization of Mutual Information

Article type: Research Article

Authors: Yao, Xin^a | Liu, Yong^b

Affiliations: [a] School of Computer Science, The University of Birmingham, Edgbaston, Birmingham, U.K. x.yao@cs.bham.ac.uk | [b] The University of Aizu Aizu-Wakamatsu, Fukushima 965-8580, Japan. yliu@u-aizu.ac.jp

Abstract: Learning and evolution are two fundamental forms of adaptation. There has been a great interest in combining learning and evolution with neural networks in recent years. This paper presents a hybrid learning system for learning and designing of neural network ensembles based on negative correlation learning and evolutionary learning. The idea of the hybrid learning system is to regard the population of neural networks as an ensemble, and the evolutionary process as the design of neural network ensembles. Two fitness sharing techniques have been used in the evolutionary process. One is based on the covering set. The other is to use the concept of mutual information. The effectiveness of such hybrid learning approach was tested on two real-world problems.

Keywords: hybrid learning system, evolutionary learning, negative correlation learning, fitness sharing

DOI: 10.3233/HIS-2004-11-204

Journal: International Journal of Hybrid Intelligent Systems, vol. 1, no. 1-2, pp. 12-21, 2004