Research And Function Development Of Geological Data Discovery Mode

Geology belongs to data-intensive scientific,involves all aspects of the earth.Under the background in the era of big data,large amount of geological data and the complex type of the data made the data transmission,storage and management need higher request.Traditional data management is mainly suitable for specification,single source,low volume of structured data,cannot meet the data mining and information services.Geological big data application and service concept emerged,and the study for the geological big data application promoted to national strategic height.Because of privacy and the particularity of geological industry,there are some differences between geological data and Web big data,geological core data storage limited by the boundaries of the local area network(LAN).This article obtains from the geological big data discovery combine the big data technology and method,systematically induced and concluded the traditional method of data service,put forward the geological data discovery mode.The model contains data discovery,data arrangement,data mining and information services,is a cyclic process from no data to new data,according to the specific implementation of each link propose the reasonable solution.Data discovery study the MFT table feature in the current mainstream NTFS file system,adopt the method of extraction and reverse positive filter screens,achieve the rapid detection and localization of geological data.Implementation of data arrangement achieve the geological data classification and data cleaning quickly,by establishing a metadata model of star put unstructured data into a unified framework together,realization of geological data integrated unified management,combining ArcGISEngine provide flexible spatial data operation method,create space anchor geological data space.Combining with the mainstream of CRISP-DM standards and metallogenic prediction model of data mining process,put forward the geological data mining model,designed the attribute query and spatial query,and adopt the method of P2 P online transmission and FTP offline to make geological data resource sharing.Finally,selecting typical regional geological data for verifying the discovery model research.Geological big data discovery system using c # development language and MySQL database,integrated ArcEngine components and Nherbinate development framework,design the data found,the data arrangement,data retrieval,data transmission and data processing functions,in order to meet the different levels and different types of the professional requirements of the users.