Research On Data Quality Management Of Vehicle Operation Data Based On Metadata

With the support of information technology,the depth and breadth of data collection continue to increase,and traditional data-level units can no longer accurately reflect the characteristics of the big data era.Big data is not only the result of massive data accumulation,but the value behind it is waiting to be discovered.Beijing Public Transport Group is in an accelerated period of information construction.The application of vehicle-mounted sensors and Internet of Things technology in public transport operations has been continuously deepened.The comprehensive collection of CAN data has formed a valuable data asset for public transport groups.The core concept of the development of public transport group is to drive decision-making by CAN data,combine information technology with management mode,and build intelligent transportation.However,under the influence of many factors,the quality of bus group CAN data occurs frequently,which seriously affects the development of related application research work.This article starts from the data quality problems in the data analysis and application of Beijing Public Transport Group.Through the combination of database technology and field research,it comprehensively analyzes the quality status and causes of CAN data,and explains the difficulties faced by public transport groups in data quality management.Introduce the importance of comprehensively regulating the quality management system CAN data.Taking this as a starting point,combining the urgent needs of the bus group for data quality improvement and the actual development of the enterprise itself,a quality management system for CAN data based on metadata is proposed.Introduced the system framework and process,and focused on analyzing the combination and function of metadata in the key links of data quality management.On this basis,data dictionary metamodel,constraint rule meta-model and evaluation algorithm meta-model are constructed,which constitute the main structure of CAN data quality management.Finally,with three meta-models as the core,a quality management system is designed and implemented.The effectiveness of the quality management system proposed in this paper is verified by examples,and data quality management personnel are assisted in the discovery,location,and processing of data quality problems to improve data.The quality provides clean and reliable data support for the data analysis work of the bus group.