Integration And Development Of Natural Resource Spatial Data Application Platform Based On Hadoop

In recent years,in the field of natural resources,with the continuous development and deepening of major national projects such as national land surveys,national conditions monitoring,and spatial planning,a large amount of basic geospatial data and business application data have been generated.Faced with such a huge amount of data,how to realize the scientific storage and management of these data,and how to perform efficient analysis,query and application release of these data has become a huge challenge.Traditional storage,computing,and service models have already embarrassed the task.Therefore,it is necessary to conduct in-depth research on the storage and calculation methods of massive geospatial data to fully tap its potential value.At present,distributed storage and big data parallel computing frameworks provide new solutions to the above problems.This paper aims at the current problems in the storage and analysis of spatial big data,combined with the specific business applications and requirements of the Natural Resources Department of Ningxia Hui Autonomous Region,based on the distributed storage and parallel computing capabilities of spatial big data of the Hadoop platform,using ArcGIS Enterprise Professional GIS(Geographic Information System)service capabilities,integrated construction of Hadoop-based GIS applications,and conducted research on the following key technical points:(1)Realize distributed storage of geospatial data.Build the Hadoop platform,and use its core component HDFS(Hadoop Distributed File System)to convert geospatial data in the form of files into distributed storage in the form of HDFS.The focus is on the method and advantages of HDFS block storage,and the file block size is set to solve the problem of distributed storage of land change survey data in Ningxia Hui Autonomous Region.(2)Research how to integrate GIS services on Hadoop.The service capabilities and integration advantages of GIS on the Hadoop platform are studied.Taking the ArcGIS platform as an example,select its core component ArcGIS Enterprise for deployment to realize the combination of Hadoop's storage capabilities and ArcGIS spatial analysis and visualization capabilities,and provide a basic computing environment for the development and design of business models.(3)Development of natural resource business analysis model based on integrated platform.Using the Spark computing framework,combined with specific business requirements,we designed and developed a land-related approval service model,a land-related planning application model,and a land-based traffic analysis model.Realize the parallel and efficient analysis and calculation of geospatial data,and solve the calculation and analysis problems of natural resource business applications in Ningxia Hui Autonomous Region.