The Key Technologies Research Of Railway Master Data Management For Big Data Applications

With the advent of the big data era and the wider application of big data technology,the data has become one of the company’s important assets.Through the analysis and application of the data,the management level and economic benefit can be improved effectively.In the field of railway transportation,through nearly 40 years of railway informatization construction,the China Railway Company has built a large number of business information systems and accumulated a large amount of data,laying a solid data foundation for the application of big data in the railway industry.However,due to the weak concept of master data management in the early stage of railway information system construction,each business system was independently constructed and decentralized maintained,resulting in inconsistent railway data standards,coding,and meanings.It have caused great difficulties in data sharing and data correlation.Especially in the era of big data analysis,higher requirements have been put on data quality.Therefore,achieving the construction of unified and efficient railway master data management platform is of great significance to improving the quality of railway data and promoting the widespread application of big data technology in the railway industry.The main research content of this paper is as follows:(1)The definition,characteristics and connotation of railway master data were proposed.The relationship between big data application and master data management was analyzed.Based on analysis of railway master data management requirements,the overall architecture of the railway master data management platform was designed and proposed.The functional architecture of the platform was designed from the aspects of master data integration,master data storage,and master data release.Through combing the master data of railway with information classification,this thesis establishes the data structure of railway master data management.(2)For the demand of identifying railway master data from complex business system,this thesis puts forward a railway master data recognition model based on fuzzy analytic hierarchy process.And it uses knowledge graph technology to establish a model of railway master data.(3)The whole lifecycle model of railway master data management was designed,and innovations were made from the aspects of master data integration,master data storage,and master data release.Such as data cleaning and importing based on templates,data accessing based on WebService,dynamic properties of railway master data mapping,large amount of file sharing,date-based data version management and traceability and other key technologies were proposed.(4)For the purpose of big data applications,a method for data integration and data governance based on master data standards was proposed.The master data integration based on the Railway Data Service Platform is described,and the railway master data standard is used to clean the business data in the big data governance,which improves the data quality of the Railway Data Service Platform.(5)Research and development to achieve the core functions of master data management platform of the railway,and verify the overall architecture and key technologies.And systematically evaluated the application effect of the railway master data management platform.