The Research And Application On The Design And Maintenance Of Data Warehouse

Data warehousing technology is the evolvement result of information technology. On account of the urgent request of the enterprises and departments for new data operation methods and patterns, the stress of data operation expands from traditional OLTP to OLAP. People focus on the subject-oriented statistical information and DSS information. Data warehousing technology is one kind of completely new scheme, which syncretizes the ETL technology and the OLAP technology. Generally, after the establishment of DW, the maintenance and management of DW have great practical significance. Thereinto, it is difficult to incrementally maintain the DW. At first, this paper presents the researchful background, purpose, significance and the current research of DW, introduces the basic concepts of DW, the system framework of DW and their characteristics, the data structure of DW(including logic structure, units, metadata), the system structure of OLAP, the analysis and operation of multidimensional data set. Then, we thoroughly probe into the system structure of ETL, and discuss the practical application of ETL. We introduce how to extract, transform, clean and load data, and how to control and watch ETL. Moreover, we introduce two kinds of mature DW schemes. At last, according to the design method of DW, in actual application of Zhejiang Province floating population information system, we establish DW of the snow flake schema. On the basis of this DW, we concentratively practice the incremental maintenance using several methods, which include time badge method and Oracle transparent gateway CDC method. Then, we expatiate significant problems of DW maintenance with a view to the practice. DW technology is the perfect basis of various information operation, which has a wide development space in the future combined with Data Mining technology.