Using HDFS Data-Aware to Handle Big Data and the Evolutionary Clustering Technique

Abstract

The growing usage of cyber-enabled technologies and IoT leads to a huge volume with diverse structures of data. A lot ofBig data solutions are based on the environment. In these systems, investigations had revealed when dealing with current data. Some study has overcome the following difficulties for particular parts of graphs; however, The data of today is in several forms of data. These efficiency concerns lead to major problems like greater space in data centers and waste of resources (such as electricity usage), resulting in environmental issues (such as increased carbon emissions) [1], in line with researchers. We offer the Hadoop eco-system data-aware module. We also offer a distributed genetic algorithm encoding technology. Our approach enables Hadoop to control the distribution and placement of data depending on cluster analyses. We can handle a wide range of data formats and improve query speed and resource use. We conducted our tests on many LUBM data sets.