| With the continuous development of the Internet industry,more and more attention has been paid to the problems of mass data storage and processing,and more and more cloud platforms have emerged.Hadoop cloud platform has become a widely used cloud computing platform by virtue of its advantages such as low cost,high scalability and high reliability.Data storage on the cloud platform and interaction between different nodes in the cluster also face data security problems.When using the Map Reduce distributed data processing framework on the Hadoop cloud platform to process massive data,plaintext computing is usually performed,and temporary storage of intermediate results also needs protection.Aiming at the storage security and computing processing security of private data on the Hadoop cloud platform,and considering that data compression can improve data transmission speed and save space,this paper proposes a cloud platform encryption and compression algorithm based on chaos theory.This algorithm introduces chaotic encryption into LZO(Lempel-Ziv-Oberhumer)compression algorithm,and completes data encryption at the same time of data compression.Compared with data compression and encryption of compressed data separately,the reasonable fusion of encryption algorithm and compression algorithm can complete data compression and encryption at the same time,which can save computing resources and improve the speed of data processing.For the cloud platform encryption and compression algorithm based on chaos theory,the main research content of this paper is as follows:(1)Aiming at the problem of low compression rate of LZO compression algorithm,a chaos-based hash method is proposed to apply to the repeated string matching strategy of LZO compression algorithm.The hash method combines with the secondary hash matching strategy of LZO compression algorithm,and uses the iteration of chaotic map to do hash calculation and hash conflict processing,which can reduce hash conflict and effectively improve the compression rate of the algorithm.(2)This paper also proposes a new encryption and compression algorithm.In the process of LZO compression algorithm,chaotic stream encryption algorithm is introduced to encrypt and process key data in the compression process to save computing resources,at the same time,the encryption and compression of data are completed,which improves the data security and ensures the efficiency of the whole data processing process.(3)Build a Hadoop cloud platform,further analyze the application scenarios of the Hadoop cloud platform compression algorithm,and analyze the performance of the algorithm proposed in this paper.The experimental results show that the algorithm proposed in this paper effectively improves the efficiency of encryption and compression while ensuring security.Especially in terms of decryption and decompression,it maintains the original high efficiency characteristics and further saves computational resource consumption. |
