| With the rapid growth of Internet and the maintenance costs of website continue to increase, this paper presents Webmon entire website analysis system. With Webmon entire website analysis system, the site maintainer can be achieved on the site of a comprehensive monitoring and analysis, to ensure the quality of the whole website.Focus on the goals of Webmon entire website analysis system, this article makes need analysis of the Webmon entire website analysis system and designs the overall architecture. Webmon entire website analysis system uses three-tier Web architecture, the main function module has the management module, the grab module, the analysis module and the report delivery module. This article describes the functional requirements of each module. In this paper, the system analyzes the key technology to do the research, mainly MapReduce model, distributed database HBase and PageRank algorithm.This article focuses on the data type, data access and data tables to complete the database design. This article focuses on workflow and the completion of the key technology to complete the detailed design of each module. This article achieve average performance of website with PageRank algorithm and logical structure of the site, and calculate the user experience score, considering all aspects of the performance data of the site.This article does functional test of the Webmon entire website analysis system to prove that the implementation of the system is consistent with the expected results. At the end of this article, this article describes a concise summary and outlook. For the present in the system imperfections, this article makes specific improvements direction. |
