Research On Ship Big Data Visualization Based On MongoDB And WebGL

With the rapid development of shipping industry and information technology,there emerges an explosive growth of shipping information data and shipping industry enters into the era of big data.How to efficiently store,process and use the growing shipping data such as ship AIS(Automatic Identification System)ship dynamic data records,etc.,become a new hotspot of big data era.MongoDB and other non-relational databases appear to make up for deficiencies of traditional relational database in the high concurrent read and write scalability,which provide database support for building high-performance big data application.Big data visualization is the important means to big data analysis and application display.WebGL(Web Graphic Library)technology can directly call the computer GPU(Graphics Processing Unit)and no plug-in,providing an efficient solution for big data visualization based on Web.Based on many features of MongoDB and WebGL,and with the use of the massive ship AIS data accumulated from laboratory projects,this paper preliminarily explored the ship big data applications from the aspects of data migration,data cleaning,data services and data visualization,preparing for data mining and visualization analysis.The main work is done as follows:(1)The visualization framework design of ship big dataAdopt B/S(Browscr/Server)architecture,use MongoDB database to store the ship AIS historical dynamic data,use Node.js to build server,the front-end places use WebGL technology to realize ship big data visualization based on Web browser.(2)The data processing based on MongoDB and Spring BatchBased on Spring Batch framework,design and finish a program automatically migrate and clean ship data from Oracle to MongoDB.Provide a solution to synchronize data between Oracle and MongoDB.(3)The realization of ship big data visualization based on WebGLRealize ship big data visualization system on the Web browser based on WebGL.Development the ship big data visualization on the map in real time,rapid pickup,historical trajectory visualization and other functions.