The Design And Implementation Of Log Anylasis System Of The Grid

Grid software logs all events and activities for the storage grid, gridadministrators can use analysis of log information so as to equip the health of thegrid in order to make more optimal decisions. During the analysis and the use of thegrid log, however, faced with a wide range of problems such as a huge amount ofdata hard to read, which caused great difficulties for grid administrators andordinary users. Therefore, we urgently need a log analysis system for grid software.The system can extract useful information from the grid which can do log analysisand mining to facilitate users make better use of the grid to meet the productionneeds.This dissertation is based on the guiding ideology of Software Engineering,from the system needs analysis, several aspects of the design of the systemarchitecture, system design, system coding and system testing, and elaborated on thewhole process of the research and development of grid software log analysis system,the final design and completed a grid software log analysis, log analysis anddecision support systems. See from the business process, the system first obtainedfrom the grid nodes grid log files and pretreatment, then log analysis and miningoutput analysis results, final reports and charts. In order to reduce the reportingengine load and improve the efficiency of report generation, the pretreatmentprocess will log the initial merge log after merging data sets as the basis of theanalysis and the log of the association rule mining, analysis mainly includes asummary of statistical information grid analysis, refinement multidimensionalstatistical analysis, statistical analysis of resource access, access to user statisticsanalysis, and intrusion detection analysis, log analysis to describe the operation ofthe grid system from the full range of multi-angle.System implementations, in order to achieve the system easy to upgrade andeasy to expand the target system using J2EE Spring Struts framework; the logformat conversion and processing efficiency, system log Description XML format;log analysis in order to be more efficient in order to improve optimization, andimplementation of the association rules analysis, the system uses the improvedassociation rules Apriori algorithm; while improving operating efficiency andperformance of the system in order to achieve efficient use of memory space, thesystem introduces design patterns; to optimize system interactive performance,system log analysis results with reports and charts, a visual display.Finally, comprehensive test from the function and performance of the system,which can be seen from the test results, the grid software log analysis system isdesigned and completed in terms of features and performance meet the expecteddesign goals can be used as grid software technical support auxiliary analysis toolfor promoting the use.