Research And Implementation Of The Data Superaddition Technology Based On Data Warehouse

As the rapid development of computer application, the data warehouse technology becomes one of IT field popular research directions. Along with the market unceasingly proposed the new demand, the data warehouse urgent need high performance and the reliable data superaddition plan, which provide accurate data management to various databases and the accurate data for the data warehouse enhances the data analysis and the decision support data accuracy and the validity.According the problems, this paper analyse the related theory of data warehouse and the data superaddition technology and synthesize the advantage of current data superaddition programme, proposed a data superaddition programme TVL (Time-View-Log) that combinated the materialized view, log, time stamp, workflow and other technology. The programme TVL applied to "the government's decision support system integrated services" projects, and achieved good results. Researches and results of this paper include the following key elements:First, paper has made a more thorough analysis the difficulty and the status of data supplement programme and elaborated the characteristics of the data superaddition programme.So it porposed a new superaddition programme TVL, and applied it in the data warehousing architecture;Second, the technology of materialized view, log, time stamp, workflow completed data migration and data cleansing in the ETL process, enhancing data quality and ETL speed and reducing the influence on operational database and data warehouse;Using workflow technology separate the supperaddition cycle and data warehouse extracts cycle.Third, based on the basic structure of the data warehouse and practical requirements,the paper given specific applications of programmes TVL, achieve the data superaddtion of the "government's decision support integrated services system", including overall structure and system tiers design and overall achievement.