Affiliations: [a] Ube National College of Technology, 2-14-1 Tokiwadai, Ube, Yamaguchi, 755-8555 Japan. E-mail: muto@ube-k.ac.jp | [b] Faculty of Engineering, Yamaguchi University, 2-16-1 Tokiwadai, Ube, Yamaguchi, 755-8611 Japan. E-mail: hamamoto@csse.yamaguchi-u.ac.jp
Correspondence:
[*]
Corresponding author: Yoshihiko Muto, Ube National College of Technology, 2-14-1 Tokiwadai, Ube, Yamaguchi, 755-8555 Japan. E-mail: muto@ube-k.ac.jp.
Abstract: In this paper, we discuss the improvement of the generalization ability of Parzen classifiers, in small sample, high-dimensional setting. When the sizes of samples per class are much unequal, the performance of the Parzen classifier is further degraded. Also, in a high-dimensional space, the degradation becomes clear. In order to overcome this problem, we propose to use the Toeplitz estimator and bootstrap samples in designing Parzen classifiers. Experimental results show that these two techniques are very effective means for designing Parzen classifiers, particularly when the sizes of samples per class are much unequal, or when the number of features is large.
Keywords: parzen classifier, small training sample size, high-dimensional feature space, Toeplitz estimator, bootstrap sample
