The Design And Implementation Of Highly Scalable Distributed Storage System Based On Blockchain

With the development of the Internet of things,edge computing has become one of the research hotspots.Edge computing system is an open platform that integrates the capabilities of network,computing,storage and application at the edge of the network near the object or data source.The core of edge computing is to transfer some computing,network or storage tasks from the cloud computing center to edge devices.Compared to cloud computing,edge computing has better real-time performance,faster data processing and responsiveness,lower deployment costs,and less pressure on network bandwidth.However,the traditional edge computing framework also has its potential problems.Since edge nodes undertake a part of the computing task,the cloud platform does not need to obtain all the original data in real time,and a single edge node cannot obtain the data of other nodes in real time,resulting in the lack of appropriate channels for users to obtain the original data in real time.In addition,because there is no global data management mechanism,when users need to accurately query some original data,the traditional edge computing framework seems inadequate.Blockchain is a very popular technology in recent years,which is usually used to build a distributed and decentralized data storage and access system.It has the advantages of decentralization,robust network,flexibility,security and credibility.Blockchain is actually a kind of distributed database,which fits well with edge computing scenes and can manage the data generated by edge computing in real time.Using blockchain as the manager of original data,the efficiency of data query can be significantly improved.However,blockchain has its drawbacks when used in edge computing scenarios.Due to the large amount of data in the edge computing scenario,the burden of blockchain nodes is heavy,and the capacity scalability of the blockchain system also needs to be improved.Therefore,we design a highly scalable distributed storage system based on blockchain,apply the blockchain technology to the edge computing framework,and use a new capacity expansion scheme to enhance the capacity extensibility of the blockchain system.The design can improve the availability and reliability of the blockchain and edge computing framework.The research content of this paper mainly includes the following points:Firstly,we design a new edge computing data storage and access framework and apply the blockchain to the edge computing framework.The blockchain can increase the real-time query of original data and provide support for applications that rely on this function.In the framework,the blockchain stores metadata of the original data produced by edge terminals,so users can query the original data in real time conveniently and efficiently by querying the metadata.Secondly,on the basis of the new edge computing framework,we design new data structures and read-write process.We add the metadata structure stored in the blockchain,design the data reading and writing functions including the blockchain,and add the tamper-proof function by using hash value to verify whether the data has been tampered.Thirdly,according to the characteristics of blockchain technology and the needs of edge computing,we design the multi-chain storage mechanism as the capacity expansion method of blockchain.Multi-chain storage design divides all nodes into multiple blockchains so that multiple blockchains can share the storage task.In addition to the network structure,we also design the data distribution mechanism,read-write process and fault-tolerant mechanism of multi-chain storage design.Finally,in accordance with the framework and process design of the system,we implement the scalable storage system based on blockchain,including the edge computing framework and the storage system.We also conduct functional experiments and verification of the system by building a simulation environment.Through the verification,we ensure that the system designed in this paper can effectively realize real-time and global query,enhance tamper-proof,and improve capacity scalability of the blockchain.