Hybrid neural networks: An evolutionary approach with local search

Article type: Research Article

Authors: Iyoda, Eduardo Masato | Zuben, Fernando J. Von^{; *}

Affiliations: Department of Computer Engineering and Industrial Automation (DCA), School of Electrical and Computer Engineering (FEEC), State University of Campinas (UNICAMP), C.P. 6101, Campinas – SP, CEP 13083-970, Brazil. Tel.: +55 19 3788 3820; Fax: +55 19 3289 1395; E-mail: emi@dca.fee.unicamp.br, vonzuben@dca.fee.unicamp.br

Correspondence: [*] Corresponding author.

Abstract: Considering computational algorithms available in the literature, associated with supervised learning in feedforward neural networks, a wide range of distinct approaches can be identified. While the adjustment of the connection weights represents an omnipresent stage, the algorithms differ on three basic aspects: the technique chosen to determine the dimension of the multilayer neural network, the procedure adopted to specify the activation functions, and the kind of composition used to produce the output. Advanced learning algorithms should be developed to simultaneously treat all these aspects during learning, and an evolutionary learning algorithm with local search is proposed here. The essence of this approach is a synergy between genetic algorithms and conjugate gradient optimization, operating on a hybrid neural network architecture. As a consequence, the final neural network is automatically generated, and is characterized to be dedicated and computationally parsimonious.

DOI: 10.3233/ICA-2002-9104

Journal: Integrated Computer-Aided Engineering, vol. 9, no. 1, pp. 57-72, 2002