The Design And Implementation Of CPD Data Report Based On Oozie

With the advent of the era of Internet,the Internet technology continues to promote the development of the various fields which include the advertising industry.Advertising is in order to better marketing to bring benefits for advertisers.ln many situations,the company reflects the effect of advertising by data report,providing the powerful data support for marketing.The theme of this study is how to generate data report of CPD advertisements efficiently and automatically.An E-commerce company wants to generate data report of CPD advertisements automatically,which includes basic data,order data,media data.How to generate data report efficiently and automatically becomes problem because of a large number of data demensions and data sources.The paper decides to solve the problem by using oozie structure,pig and sqoop according to the company’s business.Specific plan is as follows:Using oozie to monitor and schedule tasks of the data report,using pig to process the data,using sqoop to transmit data,using mysql table to load data.Oozie has the perfect monitoring and scheduling system which can ensure monitoring and scheduling tasks well.In addition,oozie can loading a variety of languages to improve compatibility.Pig can process data efficiently and correctly.Sqoop can transmit data quickly.The above can improve the efficiency of report generation and degree of automation efficiently.This scheme can be used in large enterprise relies on the big data reporting system.