Research On Ocean Big Data Management And Application Technology

The ocean is the cradle of human life,an important transportation hub for world commerce,and an important treasure house of human resources.With the rapid development of modern electronic information technology and communication technology,it has promoted the wide application of various ocean monitoring technologies,such as space remote sensors,automatic buoys,multi-beam echo instruments,underwater detection equipment and so on,resulting in the explosive growth of ocean large data.Facing the diversification of large ocean data,how to build a large ocean data cloud platform with efficient management,distributed computing,flexible storage,rapid analysis and mapping has become an important issue for the construction and development of intelligent ocean.In this postgraduate,cloud computing technology in distributed computing,flexible storage characteristics,as well as the existing large data platform in data storage management and data analysis,mining and other technology advantages of integrated research,to build an efficient marine large data integrated information management platform to serve the marine economic construction.Focus on the cloud computing platform OpenStack virtualization technology and distributed computing technology,especially the distributed object storage component Swift component of elastic scalability,high availability of a detailed study to build an efficient computing and flexible storage capacity of the marine large data infrastructure(IaaS)platform.At the same time,the problem of efficient deployment of Hadoop large data platform on OpenStack is analyzed,and the solution of ocean large data management and application based on OpenStack and Hadoop integrated application is given,which realizes the problem of flexible storage and efficient calculation of ocean large data.The platform optimizes the design from two aspects: infrastructure resource optimization and platform framework construction.In the aspect of optimization of infrastructure resources,it mainly relies on virtualization technology to integrate the standard storage hardware into a large resource pool to realize resource allocation on demand;in the aspect of Constructing Marine large data platform framework,according to the particularity of marine data,it optimizes the efficient deployment of Hadoop on OpenStack platform to solve distributed design.Computational and elastic storage problems,and at the same time,the organic integration of Hadoop and WebGIS to achieve the analysis and display of large ocean data...