Research On Technologies Of AIS Ship Spatio-temporal Big Data Analysis And Visualization

With the development of big data technology in recent years,big data analysis has been widely used in the Internet and other fields,creating great value.Currently,information recommendation,autonomous driving,artificial intelligence and other technologies are supported by big data technology.As a huge basic industry,the shipping industry is generating massive amounts of data at all times.How to analyze these data and discover its internal value is the focus of current shipping big data research.Ship AIS data is an important part of shipping big data.It contains the spatio-temporal information of the ship.Through its visualization and analysis,it can track’ the ship’s trajectory,statistics and analysis of ship traffic flow and cargo flow.Supervision or shipping trade have extremely important guiding significanceAiming at the problem of analysis and visualization of AIS ship spatio-temporal big data,this article chooses GeoMesa spatio-temporal data processing middleware by building a spatio-temporal big data processing platform to realize the storage and analysis of ship historical AIS and real-time AIS data,and uses the map server GeoServer and The WebGIS toolkit OpenLayers implements data visualization,and provides an implementation method for the analysis and visualization of AIS ship spatio-temporal big data.The main research work completed in this paper includes:(1)For a large number of AIS historical data and continuous AIS real-time data,the AIS ship spatio-temporal big data processing platform was built based on the Hadoop ecosystem,and distributed software such as Hadoop,Zookeeper,Hbase,Spark,Kafka,GeoMesa,and GeoServer were selected The map server performs AIS data analysis and visualization.(2)For the historical data of AIS,the GeoMesa ingest command line command tool and the interface-based Scala programming method are used to implement data import;for the AIS streaming data,the Kafka socket connector and real-time data conversion program are designed and developed to convert the real-time AIS The data is converted into ship spatio-temporal data and stored in the Hbase database and the new Kafka.(3)Proposed four levels of AIS ship spatio-temporal big data analysis,based on GeoMesa’s GeoTools Query interface to achieve simple query and complex query of AIS ship spatio-temporal big data,and based on GeoMesa Spark to implement spatio-temporal analysis of AIS data.(4)Use GeoServer to publish vector electronic charts,and publish AIS ship spatio-temporal big data in Hbase and Kafka in layers.Combined with OpenLayers,the functions of historical ship position and real-time ship position display,ship spatio-temporal trajectory playback and other functions are realized.From the results of AIS data analysis and display,the entire set of spatio-temporal data systems based on.GeoMesa and GeoServer can easily realize the storage,analysis and visualization of ship spatio-temporal data.The platform is a useful exploration of AIS ship spatio-temporal big data analysis and visualization,and has good practical application value.