Affiliations:
Department of Computer Science and Engineering, Amrita Vishwa Vidyapeetham, Amritapuri, India
Correspondence:
[*]
Corresponding author. Jyothisha J. Nair, Department of Computer Science and Engineering, Amrita Vishwa Vidyapeetham, Amritapuri, India. E-mail: jyothishaj@am.amrita.edu.
Abstract: Deep neural networks have dramatically gained immense potential in almost every field like computer vision, natural language processing, biomedical informatics etc. Among these networks, autoencoders are popular in performing dimensionality reduction task, while learning a representation for an unlabeled dataset. A usual way of dealing with such networks is to pre-train them in a layer-wise fashion, and consequently fine-tune the whole stack in a supervised manner. In this paper, a pair-wise training strategy is proposed to determine optimum model parameters by reducing training time as well as the complexity of training a convolutional autoencoder without compromising its accuracy. The proposed approach works in a fully unsupervised manner and has been tested on datasets like MNIST, CIFAR10, and CIFAR100 and it shows that the training time has improved by an average of 25% on these three datasets.
Keywords: Deep learning, convolutional autoencoder, pair-wise training
