| With the continuous development of computer software technology,the cost and difficulty of operation and maintenance of enterprises also increase.However,for many small and medium-sized enterprises,the equipment is limited and the network environment is simple,so many small and medium-sized enterprises are not equipped with professional operation and maintenance personnel,but developers part-time.On the other hand,with the development and expansion of network technology,a wide variety of complete information is gathered online,and the value of data is increasingly prominent.Therefore,the demand for data security is increasing day by day,and the operation and maintenance of database is becoming more and more important.In view of these problems,this topic has designed and realized an automated operation and maintenance platform for small and medium-sized enterprises,which provides comprehensive and systematic services for the daily operation and maintenance of technical personnel,helps technical personnel improve the efficiency of database operation and maintenance,and intercepts the web crawler to protect the information security of enterprises from being stolen.In view of the problems existing in the operation and maintenance process of small and mediumsized enterprises,this paper designs and implements an automatic operation and maintenance platform based on B/S architecture.The platform mainly includes seven functional modules: host management,deployment tools,task planning,application release,work order system,user management,operation and maintenance monitoring,which solves the host management and automatic deployment in the operation and maintenance process.Crawler detection and abnormal monitoring and other problems.The front end of the platform uses Bootstrap framework with rich components,the back end uses Django framework with fast development and strong scalability,and uses MTV mode for development.The front and back end data interaction uses RESTful API to achieve unified management of resources.On the server side,the system’s reverse proxy,load balancing,and cross-domain request problems are realized by using the Nginx server,which consumes less system resources and can support more concurrent connections.The main work of this paper is as follows.First,in view of the problems encountered by small and medium-sized enterprises in operation and maintenance,such as lack of professional operation and maintenance personnel,chaotic host management,complex deployment process,crawler affecting service performance,database anomaly monitoring,etc.,an automated operation and maintenance platform for small and medium-sized enterprises is built to help them carry out automatic operation and maintenance.Secondly,in the past,crawler detection was rooted in specific projects,and the crawler was processed by means of front-end encryption or back-end verification,which is undoubtedly redundant.This paper creatively combines the operation and maintenance platform with crawler detection,analyzes common anti-crawling measures and methods,designs customized crawler pages,separates anti-crawling function from actual projects,and improves project interface efficiency.Make the reverse crawl more flexible.Third,after analyzing the characteristics of abnormal samples in the database and based on the previous anomaly detection,the integrated learning algorithm idea of Stacking is used to combine the isolated forest algorithm,DBSCAN algorithm,K-means clustering algorithm,LOF algorithm,random forest,Adaboost algorithm and XGBoost algorithm.A set of anomaly monitoring process is designed to make different algorithms complement each other,which reduces the false positive rate of anomaly monitoring,and the detection effect is better than the usual anomaly detection algorithm,ensuring the safe operation of the database. |