Design And Implementation Of Public Auditable Cloud Storage Based On Hadoop

With the continuous development of Web2.0, especially the explosive growth of the mobile-Internet, e-commerce and networking in recent years, the Internet has entered a new "cloud computing" era. Cloud storage is accompanied by the emergence of cloud computing is the extension and development of cloud computing. As more and more data is uploaded to the cloud storage, cloud storage can not guarantee 100% secure data, the user will need an effective means to monitor data security in the cloud storage.To solve this problem, we propose to the public auditable Cloud Storage System based on Hadoop, the system can be audited by a third party organization, allowing users to backup files in the absence of local situations, understand whether the files stored in Cloud Storage is complete or not. Firstly, we did a technology research, analysed the distributed storage systems HDFS and the public audit model. The system is designed to be composed of three subsystems, namely the cloud storage system, third-party auditors and clients. In order to reduce the degree of coupling between subsystems and improve the scalability of the system itself, each subsystem uses the REST-style architecture. It also introduces the message queue mechanism, with the asynchronous nature of the system, to improve the overall performance of the system. In addition, the system refer to the "cloud computing" concept basis, and also put forward innovative data integrity verification service concept. The innovation is that the validation data is completely transparent to the user, without restrictions of time and space.Through systematic analysis and tests show the public auditable cloud storage system based on Hadoop can effectively verify the data integrity in the cloud storage.