Design And Research Of Intelligent Meter Cloud Service System Based On Hadoop

Into the 21 st century,the smart grid has always been a hot research and application in the power industry,and has been highly valued by China and other countries.Smart electricity meter is an important part of the construction of smart grid.In the process of intelligent meter promotion and continuous development,the power sector and related enterprises have accumulated a lot of power data.These data are not only characterized by massive,high frequency,heterogeneous and decentralized,There is a correlation between data and similarity.The data acquisition,storage and processing ability of traditional power system can not meet the demand,in the face of smart meter data of large scale production,for the collection,storage and application of a power system construction has always been seeking to correct and real-time power data.With the rapid development of communication technology and cloud computing,people demand for diversification,convenience and personalized electricity payment management service,intelligent electricity meter cloud service has become an urgent trend.Based on the current situation of domestic and foreign research of intelligent electricity meter cloud service,this paper gives some new ideas and solutions based on some problems and needs encountered in the reality work of electric power enterprises,and puts forward the design objectives and principles of "intelligent meter cloud service system based on Hadoop",mainly in order to solve the traditional power system in the existence of power data collection real-time and reliability is poor,mass heterogeneous data storage and processing difficulties,and electricity services,a single,opaque and other issues.Firstly,the research situation of smart meter cloud service is introduced and summarized,and the problems of data acquisition,storage and application are analyzed emphatically.The research status of cloud computing technology,especially Hadoop platform,is summarized and analyzed.According to the function and performance requirements of the system,the overall architecture of the intelligent meter cloud service system based on Hadoop is designed,which clarifies the design difficulties and the key support technology.Secondly,based on the parallel data acquisition and distributed storage computing scheme constructed in this paper,the data acquisition layer,data storage layer and system application layer of the cloud service system are analyzed and designed in detail.Using WIFI high speed and remote communication and the dual data access server realized the active reporting of the meter data,completed the large data storage based on the traditional database and Hadoop cluster and the large data analysis and calculati on function based on the distributed programming model Map Reduce,realized the cloud service system Basic electricity payment management services.Finally,this paper introduces the installation and configuration of Hadoop and HBase distributed clusters in detail.It is proved that the Hadoop platform can store and process massive data by using the Hadoop platform,which can achieve the advantages of traditional methods and have the ability of high data storage and access;The design of distributed Map Reduce program to deal with massive log files,can be very easy to achieve mass data parallel processing;In addition,through the integration of the various modules of the system,the cloud service functions were tested to verify the feasibility and efficiency of the program.