Research On Massive Power Quality Monitoring Data Cloud Platform Based On Hadoop

With the continuous expansion of the scale of power quality monitoring and the continuous improvement of the frequency of power quality monitoring data acquisition,the long-term monitoring of power quality will form the power quality big data.The existing power quality monitoring system mainly uses the relational database to store data,and uses the traditional centralized processing method to analyze the data.In the face of increasingly large and complex power quality monitoring data,the existing power quality monitoring system can not meet the requirements of large data storage,analysis and low calculation efficiency,it is difficult to effectively use the power quality big data.In recent years,cloud computing as a popular research of Internet and big data has the feature of high reliability,fast processing of large data and good expansibility and so on.According to the power quality monitoring cloud platform launches the following research:analysis of components such as parallel computing framework based on cloud platform in the Hadoop cluster and MapReduce,research on energy efficient storage and analysis of large data quality of cloud computing platform.In the aspect of data storage,the distributed data base HBase is used to realize the centralized storage and column store of power quality data,the data retrieval efficiency is improved and safety and reliability of data is ensured.In the aspect of data processing,based on MapReduce parallel computing framework of power quality statistics and evaluation algorithm,the analysis process of concurrency is enhanced,the energy efficiency of the calculation and analysis of quality is improved,through the interaction between JavaEE and Hadoop,the power quality data storage and calculation program is compiled,debugged and run.Cloud computing technology solves the problem of storage and computing efficiency of mass power quality data.At last,the Hadoop cluster is built by using a number of cheap host computers in the laboratory,and the experimental analysis is carried out.The experimental results show that the cloud computing platform with power quality monitoring and analysis of massive data processing based on high efficiency,high reliability storage advantages,proved the effectiveness and superiority of the cloud platform and provided a new scheme for power quality monitoring.