Improving neural networks generalization with new constructive and pruning methods

Issue title: SBRN'02

Article type: Research Article

Authors: Costa, Marcelo Azevedo | Braga, Antônio Pádua | de Menezes, Benjamin Rodrigues

Affiliations: Department of Electronics Engineering, Federal University of Minas Gerais, Campus da UFMG (Pampulha), Caixa Postal 209, CEP 30 161-970, Belo Horizonte, MG, Brazil. E-mail: {mcosta,apbraga,brm}@cpdee.ufmg.br

Abstract: This paper presents a new constructive method and pruning approaches to control the design of Multi-Layer Perceptron (MLP) without loss in performance. The proposed methods use a multi-objective approach to guarantee generalization. The constructive approach searches for an optimal solution according to the pareto set shape with increasing number of hidden nodes. The pruning methods are able to simplify the network topology and to identify linear connections between the inputs and outputs of the neural model. Topology information and validation sets are used.

Journal: Journal of Intelligent & Fuzzy Systems, vol. 13, no. 2-4, pp. 75-83, 2002/2003