Information Quality Assessment Of Power System Based On The Big Data

With the expansion of modern power systems,as well as ever-developing technology and reduced costs of measurement devices,the recorded data in power systems have been increasing significantly and progressively exhibit the feature of big data.Much attention has been paid to the full use of big data for improving the planning,operation and control of modern power system,and hence how to evaluate the quality of big data is becoming an important problem to be examined.Some research publications are available on data quality improvement,such as data cleaning,data integration,and detection of similar records,but the existing research work is still preliminary in data quality evaluations.In this context,a comprehensive evaluation method of power data quality is proposed,which is based on the characteristics of power system and the quality of the Big data.Overall assessment of the mass,sometimes the actual distribution of all kinds of quality vary greatly,so the combination evaluation method is reasonable,therefore the entropy method and Grey evaluation method are combined with to construct electric big data quality assessment model based on Hadoop platform,This model describe the process of getting the power big data state evaluation.In this context,The power system data is the main research object,expounding the main problems of the quality of power system data face with.First,According to the international standard ISO/IEC 25012 and based on the Features of the Big power data,the general quality assessment index of power system data are refined,and then aiming at the timeliness of big data processing,Using the K-means clustering algorithm which is implemented in parallel by MapReduce to complete fast processing of the big data sample set.Next,The entropy weight method is employed to calculate the objective weight of each dataset.Finally,power data acquisition of a power company are used for example analysis,the data quality level is attained by the grey evaluation method,On this basis,the comprehensive evaluation of the sample data set is carried out.the calculation results show that the proposed method can quantitatively describe the index system according to the business rules and requirements,Grey entropy comprehensive evaluation method for evaluating large data quality has better performance in time efficiency.