Research On The Optimization Strategy Of Data Management For Data Center Of Ministry Of Education

Researched the education data storage, task scheduling, fault-tolerant deployment and other issues in this dissertation, all that aiming to reduce the overall cost of education data management, enhance the efficiency and reliability of the system, considering the constraints of information security and network infrastructure, software and hardware resources, with the rapid growth of massive education data and huge demand analysis in educatonal area.The main contributions of this dissertation are as follows:(1) Proposed the minimum storage cost policy in reducing the cost of the storage space and improve the efficiency of data query and analysis of education,with the construction of the query hot measure data column combination based on defining the hot values on the nodes load in the cluster. Put forward the combination of columns and column clustering portfolio allocation strategies based on correlation and selected a more suitable distributed parallel processing mode in the cost and the scale-out capability against the higher cost of traditional shaft construction mode for the education data center, no difference in data storage caused by lower storage space utilization.(2) According to the response requirement and huge pressure in education data query analysis, data analysis tasks of education are quantified and prioritized, considering the cost of services, the quantitative node load capacity of analysis, and proposed "Education Data Scheduling Model Based on Utility". Based on the overall load rate of the system, the optimal task scheduling strategy is proposed.(3) Proposed the definition of the importance of data according to the characteristics of the combination of the education data. Based on the importance of data and node load, the data selective recovery strategy is proposed to improve the system's availability.(4) According to distributed data node failure problems of the education analysis system, put forward the optimization deployment model and resource deployment strategy with the node fault, to ensure the integrity and availability of data, and provided the operation and maintenance strategy of education data center to improve the service reliability of the system.