Research On Flood Data Storage And Management Based On HBase And HDFS

The storage and management of flood data is an important part of flood control and disaster mitigation.With the increase of the amount of flood data,the storage and management of flood data constrain the capacity of flood control and disaster reduction.It is necessary to study the storage and management of flood data in order to enhance the ability of flood control and disaster reduction and reduce the loss of flood.Based on HBase and HDFS,this paper studies the storage and management of flood data.The main contents are as follows:1 Requirements analysis and storage designThe storage status of flood data is studied,and the data storage and management requirements of flood data based on HBase and HDFS are presented.According to the characteristics of flood data,flood data were classified,and the storage scheme of flood data in HBase and HDFS was designed,and the data storage methods were designed respectively.2 Data management and key technologyOn the basis of summarizing the traditional cloud management platform,the design and implementation of flood data management.Use winForm control to change and achieve flood data,graphical display,data table display,text display.According to the data storage scheme o f flood disaster,we designed and realized the upload and download of flood data file and flood data record separately.In the flood data deletion function,the deletion of basic data and warning data is realized,and the deletion of historical data is pro hibited.Implementation of HBase table query and display table query.HBase table query,proposed and implemented index field selection method and query method of choice,and provides shp to json conversion function.3 Flood data consolidation and cloud management verificationAccording to the problems of data collection and collation in flood disaster,the software of data acquisition and collation is developed to realize the geocoding of the flood data,the acquisition of the basic data and the coordinate conversion function,which is convenient for the flood data collation.Based on the data of the 1998 floods in the Yangtze River Basin,the data storage and management of floods based on HBase and HDFS were verified.This method provides a variety of flood data storage and management,to meet the flood data storage and access.This storage and management method facilitates the expansion of early warning and loss assessment module,providing data storage and management services for flood control and disaster mitigation.