Research On Matching And Update Of Traffic Vector Data Based On Etl Technology

Nowadays,scientific research has developed into a data-intensive paradigm,and the advent of the era of big data poses multiple challenges for data processing.Traffic vector data has heterogeneous characteristics such as extensive sources,various types,complex structures and different precision.Its multi-source heterogeneity brings a challenge to vector matching.The main purpose of this paper is to establish effective traffic vector matching methods and explore the incremental updating mechanism for different traffic vector data types.It brings certain value and significance on the construction and maintenance of the national foundation traffic vector data in geographic information database.The main tasks include:(1)Establish the traffic vector data extraction conversion templateFirstly,we compare and analyze the differences of traffic vector data in classification and layering,data format,attribute coding and other aspects.Considering the differences of traffic vector data and the standard specifications of traffic vector data,the data warehouse mode is selected to extract and transform the traffic vector data.We use ETL technology to help establish the transformation template of traffic vector data extraction and build the traffic vector master library.(2)Realize the traffic vector data matchingSecondly,traffic vector data matching is realized by using vector matching algorithm,thus mutual matching elements are obtained.According to the matching degree,it can be divided into high matching,medium matching,low matching and non-matching.On the basis of geometric matching,the attributes of traffic vector matching each other are transferred to improve the related attributes of traffic vector data.Traffic vector data matching includes geometric feature matching and attribute feature transfer.(3)Discuss the incremental update scheme of traffic vector dataFinally,the difference data obtained from factor matching is taken as incremental traffic data.Based on the extracted incremental traffic data,a variety of traffic vector data updating schemes are proposed.The incremental updating of traffic vector data from different sources or different years is realized and the linkage updating mechanism of traffic vector data is discussed.The results show that ETL technology can be used to establish the traffic vector data extraction conversion template according to the traffic vector data standard specification.Geometric feature matching and attribute feature transfer of traffic vector data are realized.Use incremental data to incrementally update traffic vector data from different sources or versions of different years.The data extraction and transformation based on ETL technology is of high efficiency,reducingthe impact of manual intervention and providing data support and application services for traffic thematic maps.