Geological Information Management System Based On Hadoop

The geological and mineral work has a long history and great significance.The data and information accumulated by the geological and mineral industry over the years are worthy of the name of "geological big data".In the face of massive geological data,how to realize the sharing and interoperability of multi-source heterogeneous data and extract the most valuable information according to the social needs is one of the core contents of geological investigation and research in the era of big data.In this paper,based on the in-depth study of the relevant data and software system of geological big data storage at home and abroad,combined with the actual situation of geological data in the experimental area,and based on the distributed file system HDFS,distributed database HBase and data warehouse hive,the geological exploration data is stored and the geological information is managed.Map Reduce in Hadoop platform can be used for parallel computing of massive data,which greatly improves the correlation between data.The geological data of the experimental area are collected and sorted out,and the geological data are read and written in the distributed file system HDFS;secondly,the data of the file system is stored by the distributed database HBase,which stores the geological data through columns.In addition,based on the data warehouse hive,the data in the file system HDFS is stored.Hive stores the file data through its own HQL language,and maps it into external data tables for storage and analysis.It also introduces the table structure of geological data stored in hive,the geological data table stored in data warehouse,and the analysis and query of different geological data through shell command line,which realizes more convenient and efficient management of geological data.Finally,through the Hadoop big data platform,a set of geological information management system for geological data query and addition,deletion and modification is designed and implemented,and the functions of geological data query and report output are also realized.When logging in the system,you can set the user's authority.If you are not an administrator,you can't add,delete,modify and check the geological data.The system is divided into three modules: geological data browsing,geological data management and other functions.The functions of the above modules can view the data,add,delete and modify the basic operations as well as report output,so as to realize the management of geological data.There are 56 charts,10 tables and 80 references in this paper.