Management And Analysis System Of Oil And Gas Pipeline Data Based On Graph Structure

In order to ensure the safety of oil and gas transportation,China has carried out the analysis and research work on oil and gas pipeline video,image,radar and other data.However,at this stage,the management of oil and gas pipeline data organization is cumbersome.There are problems such as inefficient data management,reuse difficulties,data relationship analysis,and cumbersome historical retrospective operation.Therefore,in response to the needs of Sinopec Dalian Research Institute,this paper aims to develop an management and analysis system of oil and gas pipeline data that meets the needs of automated data injection,data cleaning,data quality analysis,and provides risk data analysis and customized retrieval services.The focus of this paper is to combine the concept of knowledge graph with oil and gas pipeline data,divide the data content and extract knowledge,and construct the knowledge graph of risk events centered on the data entity and the inspection event.Using the characteristics of graph structure,the functions of data association search,data quality analysis and data consistency test are realized.Combined with the improved En-TransE knowledge representation learning model,the reasoning and prediction of pipeline risk events are realized,and the feasibility of knowledge graph learning in the field of oil and gas pipeline safety is explored.In addition,a similarity algorithm based on mixed fingerprint is designed to realize the custom image retrieval function and improve the accuracy of system retrieval.The system as a whole adopts a B/S architectural model with a development strategy that separates the front and back ends.According to the requirements analysis,the system is divided into six parts: data statistical analysis module,pipeline data injection module,data graph module,data retrieval module,system user management module and system supervision module.In addition,the system provides Nginx + Redis access interception and Jwt permission authentication and other security measures.The front end of the system is modularly developed with a Vue framework in conjunction with the elementUI,and the graphical presentation of various types of data is achieved in conjunction with Echarts.Back-end business services mainly use SpringBoot,combined with MVC three-tier structure to achieve service-side development.The database is supplemented by the Neo4j graph database with mysql relational database,which is associated with fastDFS distributed file system by way of path storage to realize the storage of a large amount of unstructured data.After deployment and test acceptance,the system meets the business needs of the actual situation,provides the functions of automatic data injection,data cleaning,graph analysis,image retrieval and so on,and provides great convenience for the organization and management of oil and gas pipeline data and data analysis.