Research On Campus Big Data Analysis And Visualization

Under the guidance of the construction concept of “One Library and One Table” project,the campus informationizat ion project of colleges and universit ies has been continuously promoted,and the accumulated campus data has been gradually integrated to form school management,teaching management,book borrowing information,student consumption data,etc.A shared data platform for data.This gives us the opportunity to explore the hidden laws of student behavior.This paper analyzes the characteristics of college campus big data,and then analyzes the data reflecting student behavior and life learning state.It uses the Spark platform to summarize the massive data and visualize it through Alibaba Cloud's Data V tool.This allows the whole school to discover and improve their own problems,and also feedback the school's operation,so that it can be improved in time.main tasks as follows:(1)Introduce and deploy the Spark and DataV required in this paper,and extract and clean relevant data from the school public data platform,and standardize the data.(2)The student behavior portrait library is designed for student behavior,and the data denoising work is improved by the improved LOF algorithm.Finally,the K-means++ algorithm is used for clustering.The optimized LOF algor ithm is denoised by exper iments.The more traditional LOF algor ithm has a stronger improvement in time complexity.(3)Introduce the analysis of association rules to discover the interesting connection between student behaviors,introduce and improve the Apriori algor ithm,and link the student's performance with the students' consumption behavior,living habits and learning effort,and derive the scores and The relationship between the three provides a behavioral reference for students to improve their performance.(4)Designed and realized the visual display of big data based on DataV,and displayed the results with the large screen of the library,the large screen and the pers onal screen of the student personal service,and proved the management work and education provided by the school.help.