Research On Regional Cathodic Protection Data Management Platform Of Long Distance Pipeline Based On Big Data

In recent years,along with the research on the intelligent oil and gas pipeline,every link in the maintenance pipeline needs to realize the intellectualization.Among them,in the electrochemical protection of oil and gas pipelines,the realization of intelligent cathodic protection device is a problem to be solved.In order to realize the intelligent management of cathodic protection,it is necessary to build a data management platform that will collect,store and analyze the various factors affecting cathodic protection according to the regional distribution.In this paper,a regional cathodic protection data management platform based on big data is studied,which can realize the data management of soil,the most important factor among multiple factors affecting cathodic protection,and provide a good platform for automatic adjustment of cathodic protection parameters and electrochemical corrosion prediction.Firstly,according to the soil environment that affects the operation of cathodic protection and electrochemical corrosion,the rough set algorithm in data mining was used to establish the soil corrosion grading evaluation model rs-ew-spa.Through Python operation model,soil corrosion was divided into four grades,and soil corrosion grade and influence degree of each index factor at each test point were calculated and sorted,and different files were generated according to requirements.The model is proved to be suitable for soil corrosion grading evaluation of oil and gas pipelines.Secondly,I designed the regional cathodic protection data management platform based on Hadoop,including designing the overall architecture,analyzing the characteristics of the system,designing the Hadoop cluster architecture and building process,designing the distributed data storage and diverse queries.Finally,virtual software and hardware environments were deployed according to the system architecture,and files generated by the rs-ew-spa model and other different types of files collected related to cathodic protection were used to test the platform,and file upload,storage,analysis,query,download and other functions were realized on the platform.