Bigdata clustering and classification with improved fuzzy based deep architecture under MapReduce framework

Article type: Research Article

Authors: D, Vishnu Sakthi^a | V, Valarmathi^b | V, Surya^c | A, Karthikeyan^{d; *} | E, Malathi^e

Affiliations: [a] Department of Computer Science and Engineering, R.M.D Engineering College, R.S.M Nagar, Kavaraipettai, Tamil Nadu, India | [b] Department of Information Technology, Sri Sairam Engineering College, Chennai, Tamil Nadu, India | [c] Department of Computer Science and Engineering, Sathyabama Institute of Science and Technology, Chennai, Tamil Nadu, India | [d] Department of Computer Science and Engineering, Panimalar Engineering College, Chennai, Tamil Nadu, India | [e] Department of Computer Science and Engineering, Kongu Engineering College, Perundurai, Tamil Nadu, India

Correspondence: [*] Corresponding author: Karthikeyan A, Department of Computer Science and Engineering, Panimalar Engineering College, Chennai, Tamil Nadu, 600123, India. E-mail: karthikeyana7288@gmail.com.

Abstract: The current state of economic, social ideas, and the advancement of cutting-edge technology are determined by the primary subjects of the contemporary information era, big data. People are immersed in a world of information, guided by the abundance of data that penetrates every element of their surroundings. Smart gadgets, the IoT, and other technologies are responsible for the data’s explosive expansion. Organisations have struggled to store data effectively throughout the past few decades. This disadvantage is related to outdated, expensive, and inadequately large storage technology. In the meanwhile, large data demands innovative storage techniques supported by strong technology. This paper proposes the bigdata clustering and classification model with improved fuzzy-based Deep Architecture under the Map Reduce framework. At first, the pre-processing phase involves data partitioning from the big dataset utilizing an improved C-Means clustering procedure. The pre-processed big data is then handled by the Map Reduce framework, which involves the mapper and reducer phases. In the mapper phase. Data normalization takes place, followed by the feature fusion approach that combines the extracted features like entropy-based features and correlation-based features. In the reduction phase, all the mappers are combined to produce an acceptable feature. Finally, a deep hybrid model, which is the combination of a DCNN and Bi-GRU is used for the classification process. The Improved score level fusion procedure is used in this case to obtain the final classification result. Moreover, the analysis of the proposed work has proved to be efficient in terms of classification accuracy, precision, recall, FNR, FPR, and other performance metrics.

Keywords: Map reduce framework, improved feature fusion, normalization, fuzzy C-means clustering

DOI: 10.3233/IDT-230537

Journal: Intelligent Decision Technologies, vol. 18, no. 2, pp. 1511-1540, 2024