Enhanced regression model using cluster based sampling techniques

Article type: Research Article

Authors: Dhamodharavadhani, S. | Rathipriya, R.^{; *}

Affiliations: Department of Computer Science, Periyar University, Salem, Tamil Nadu, India

Correspondence: [*] Corresponding author. R. Rathipriya. E-mail: rathipriyar@gmail.com.

Abstract: This paper aims to develop the methodology for enhancing the regression models using Cluster based sampling techniques (CST) to achieve high predictive accuracy and can also be used to handle large datasets. Hard clustering (KMeans Clustering) or Soft clustering (Fuzzy C-Means) to generate samples called clusters, which in turn is used to generate the Local Regression Models (LRM) for the given dataset. These LRMs are used to create a Global Regression Model. This methodology is known as Enhanced Regression Model (ERM). The performance of the proposed approach is tested with 5 different datasets. The experimental results revealed that the proposed methodology yielded better predictive accuracy than the non-hybrid MLR model; also, fuzzy C-Means performs better than the KMeans clustering algorithm for sample selection. Thus, ERM has potential to handle data with uncertainty and complex pattern and produced a high prediction accuracy rate.

Keywords: Clustering, KMeans, fuzzy c-means, multiple linear regression, regression, sampling methods

DOI: 10.3233/JIFS-211736

Journal: Journal of Intelligent & Fuzzy Systems, vol. 44, no. 2, pp. 3059-3069, 2023