An improved third term backpropagation algorithm – inertia expanded chebyshev orthogonal polynomial

Article type: Research Article

Authors: Sornam, Madasamy^{; *} | Vanitha, Venkateswaran

Affiliations: Department of Computer Science, University of Madras, Tamil Nadu, India

Correspondence: [*] Corresponding author. M. Sornam, Department of Computer Science, University of Madras, Tamil Nadu, India. E-mail: madasamy.sornam@gmail.com.

Abstract: The standard backpropagation algorithm has already proven its effectiveness in most of the potential problems, but the major limitation is entrapment of local minima and slow convergence rate. To address these issues, a modified backpropagation algorithm has been proposed by adding a third term called inertia, the physical component used to accelerate the network towards the convergence without getting stuck into local minima. The Chebyshev polynomial form is a convenient method for expanding a function in a linear independent term. Inertia has been expanded using Chebyshev polynomial which is used as a third term in weight updation. The performance of the proposed algorithm outperforms the standard backpropagation algorithm (SBP) and the backpropagation algorithm with momentum (SBPM). The proposed algorithm was tested with the standard benchmark problems such as XOR problem, parity checking problem and dataset from UCI machine learning repository such as iris flower classification, wheat classification, breast cancer detection and wine classification. Experimental results show that the addition of the third parameter called inertia in the backpropagation algorithm gave better performance and faster convergence rate compared to the SBP and SBPM.

Keywords: Back propagation, chebyshev polynomial, feed forward neural network, inertia, momentum

DOI: 10.3233/JIFS-190063

Journal: Journal of Intelligent & Fuzzy Systems, vol. 37, no. 3, pp. 3795-3804, 2019