Design And Implementation Of Internet Log Analysis System Based On Hadoop

Nowadays,as the number of college students is on the increase,how to better achieve accurate management of students has become a main concern of colleges and universities at present.With the student's Internet access log data as the entry point,this study understood the students' Internet access time and preferences through the analysis of the log data of students using campus network to browse the webpages,thus managing the students according to their daily Internet access habits.For this reason,a campus Internet access log analysis system was designed and implemented based on Hadoop platform.In this study,the background,objective and significance of the systematic research was introduced,and the working principle of related technology involved in the system was summarized.The overall demand of the system was analyzed,and modules were divided according to the functions to be realized by the system.After detailed requirements analysis,the hardware platform was constructed,each functional module was designed,and structured processing and visual presentation was conducted on students' Internet access log data.In addition,the visual presentation results were analyzed,and some suggestions for the current college student management were summarized according to the current students' Internet access behaviors and preferences.Finally,the whole system was summarized and prospected.The Internet access log data analysis platform studied in this thesis can analyze students' daily Internet access time and preferences by extracting,processing and presenting students' Internet access log data.Colleges and universities can use real-time processing results to manage students' Internet access behaviors and guide students' Internet access preferences,thus standardizing students'Internet access behaviors,promoting accurate supervision,and helping students better complete their studies.