Design And Implementation Of Satellite Test Data Management System

The satellite is the most widely launched,the most widely used,the fastest growing spacecraft,it has important significance for scientific research,weather forecasting,land use,communications and other fields.During the development of the satellite,a large amount of data will be generated,and the successful launch of each satellite can not be separated from the effective collection,management and utilization of these data.At present,the domestic research is basically through the development of data management system to manage the data,but due to the rapid development of satellite technology,the speed of new data management business is very fast,so the data management system must have the ability to modify and expand rapidly,or keep update constantly to meet the needs of new business.However,the speed of updating the system often can’t keep up with the speed of business change,which leads to the gradual elimination of the system,resulting in waste of manpower and material resources.Therefore,developing a data management system with rapid expansion and modification capability which can adapt to the rapid change of satellite data management business is the key to solve these problems.Firstly,this paper analyzes the business process of satellite test data from generation to storage and utilization,summarizes the main requirements of each business process and the technical difficulties of realizing each demand.Then,this paper chooses the appropriate software process model and designs the corresponding data model for each business process,using custom configuration files,Hbase,Map Reduce and other technologies to solve the difficulties of each business,developed a satellite test data management system to collect,store,manage and utilize the satellite test data.In data storage,the system uses Hadoop technology to realize the storage of semi-structured data,unstructured data and unknown structure data,realized the function of extracting unknown target data from multiple data files based on filter rules.The implementation of this function ensures that no matter how the changes in the requirements of the satellite test business will be changed,the system will be able to store the data uniformly.In data utilization,the system implements a comparative recommendation function,it will recommend data to users when they are querying data,which will help users to mine the relation between data,and discovery the potential problems timely.Realized the automatic report generation function based on user template customization and distributed processing technology,each experiment report has a fixed template,the realization of this function greatly reduces the repeated work of users,improve their work efficiency.Finally,this paper tests the performance of each module and the overall performance of the system,and the results show that both the function and the performance of the system have met the requirements.After the completion of the system development,it has been docked with other platforms of the Institute,and it has been deployed and put into use.The system support for data storage business customization and expansion,it reduces the storage cost of the satellite test data,makes the data more effectively utilized,and improves the efficiency of the staff,it has achieved the anticipated development goal.In addition,mining data stored in the system is a very meaningful work,but at present,due to the uncertain user demand,unclear mining target and small amount of data,the data mining function has not yet been realized,which is the future direction of the paper.