Research And Implementation Of Distributed Storage Based On Redis In Cloud Management Platform

Cloud computing technology and cloud management platform are the hotspots of research and application at present.Aiming at the data access efficiency of the private cloud management platform of the game development team,this thesis studies the redis based distributed storage technology to improve the performance of the platform,and designs and implements the cloud management platform server on this basis.However,redis cluster,the current mainstream distributed caching solution,has two disadvantages: multiple connections between the client and the server,and does not support multi key operations across slots and nodes,which limits the service adaptation ability of this solution.Although existing practitioners avoid cross slot and cross node operations by controlling data distribution or encapsulating multiple requests with pipeline operations,they all belong to application layer solutions,which affect performance and do not solve the problem in essence.Therefore,this thesis proposes a cross slot and cross node operation method of redis cluster based on data communication between nodes,and designs the client cache in the cloud management platform based on this method to solve the above two problems.The main research work of this thesis is as follows:(1)Aiming at the problems of supporting multi key operations across slots and nodes in the native redis cluster distributed cache cluster and multiple connections caused by the first connection miss,a data communication mechanism between nodes is constructed.This mechanism has the advantage of zero intrusion into business code,supports high-efficiency multi key operations across slots and nodes,and solves the problem of multiple connections from the server level.Based on the data communication mechanism,the affinity design is used to optimize the communication efficiency when the traffic is low,and the load balancing algorithm is used to smooth the communication pressure of each node during the traffic peak.The two cooperate to improve the performance of the communication mechanism between nodes.The effectiveness of the proposed method is verified by the official test tool redis benchmark.(2)Based on the above research,the underlying code of the native redis cluster is deeply analyzed,and the private cloud management platform server of the game development team based on the improved redis cluster distributed cache technology is designed and implemented by using Springboot and Lettuce framework.Cache and synchronize the cluster metadata on the service side of the cloud management platform in real time,and design a configurable cache directed connection pool to realize client caching,so as to reduce the problem of frequent multiple connections.The Apache JMeter pressure test tool is used to test the full link of the cloud management platform server.The test results show that the cloud management platform server designed and implemented in this thesis meets the performance requirements and is better than other schemes.