Artificial neural networks applied for estimating a probability density function

Article type: Research Article

Authors: Colla, Valentina^{a; *} | Vannucci, Marco^b | Reyneri, Leonardo M.^c

Affiliations: [a] Electronic Department, Politecnico di Torino, Torino, Italy | [b] PERCRO Laboratory, Via L. Alamanni, TeCIP Institute, Scuola Superiore Sant'Anna, Ghezzano, Italy | [c] Electronic Department, Corso Duca Degli Abruzzi, Politecnico di Torino, Torino, Italy

Correspondence: [*] Corresponding author: Valentina Colla, Electronic Department, Politecnico di Torino, C.so Duca degli Abruzzi 24, 10129, Torino, Italy. Tel./Fax: +39 011 564 4038; E-mail: leonardo.reyneri@polito.it.

Abstract: The estimate of the probability density function or probability mass function of an unknown stochastic process is a very important preliminary step for any further elaboration. Most of the traditional approaches to this problem perform a preliminary choice of a parametric mathematical model of the function to estimate and a subsequent fitting on its parameters. To this aim some a-priori knowledge and/or assumptions on the phenomenon under consideration are needed. In this paper an alternative approach is proposed, which does not require any assumption on the available data, as it extracts the probability density function from the output of a neural network, that is trained with a suitable database including the original data and some ad hoc created data with known distribution. The results of the tests performed on synthetic and industrial databases are described and discussed in the paper.

Keywords: Probability density function, probability mass function, weighted radial basis function networks, industrial databases

DOI: 10.3233/IDA-140694

Journal: Intelligent Data Analysis, vol. 19, no. 1, pp. 29-41, 2015