The Research And Application For The Real-time Pre-processing Model Of Multi-source Heterogeneous Meteorological Data Based On Supermap

Along with the development of informatization, many departments have gradually established up their own business information systems, but due to the sharing ideas and sharing technology of government departments, even if each department where located in different geographical position has the sufficient data, these huge amounts of data are still not be Shared effectively and make full use of it. And even in the same department, because each business system set up time and providers are different, the data sourse、torage method and record format are also different, so the multi-source heterogeneous data inconvenience for data sharing between systems. At the same time, along with the rapid development of society, the real-time demand of data is higher and higher in many departments, because the high real-time performance of data means that the department seniors can make more timely and more accurate decisions according to the real-time data.To cure the above problems, this paper proposes a multi-source heterogeneous data real-time processing model. According to the type of target data source, this model can design the real-time Monitoring proposal to monitor the update of files in each data source in real time, develop a strategy to parallel process data and audit and process the vast amounts of real-time data files in real time. The modle still converts the heterogeneous meteorological data files recorded as text or binary data to the GIS spatial data which has the unified formats. Finally the model saves data to the database in real time, and finishes the GIS visualization of the Multi-source heterogeneous mass meteorological data, at the same time, the model realizes the real-time sharing of the multi-source heterogeneous mass meteorological data between each department system. So in this paper, the main work and innovations are as follows:(1)According to the characteristics of the Multi-source heterogeneous mass file, this paper combines with the demand of each department in the real-time performance, and designs a multi-source heterogeneous data real-time processing model.(2)This paper applies the multi-source heterogeneous data real-time processing model on the meteorological data processing successfully, and has realized the real-time sharing of the Multi-source heterogeneous mass meteorological data between each department system.(3)Based on the GIS components----SuperMap, the system finishes converting the heterogeneous meteorological data files recorded as text or binary data to the GIS spatial data which has the unified formats, and realizes the GIS visualization of all kinds of meteorological data.At present, this system has been successfully applied in the meteorological bureau of Jiading district in Shanghai, and provided great help for its day-to-day business. At the same time, the implementation of this system has certain reference value to the sharing of other type data in real time.