Research On Reliable Distribution Technology Of Edge Data

In recent years,with the rapid development of the Internet of Things,human society is rapidly entering the era of the Internet of Everything.A variety of new smart application scenarios(such as autonomous driving,smart transportation,interactive online games,etc.)and a dazzling array of terminal devices are continuously emerging for people’s lives.New types of applications have high requirements for data access latency,and the continuously generated data has also created new requirements in terms of storage reliability.Traditional cloud storage has long transmission links,high access latency,and centralized access.Local storage also faces problems such as difficulty in data backup.Edge storage solutions have become a viable alternative to make up for the lack of cloud storage.However,the geographical location of edge storage devices around the terminal devices also brings many problems.First of all,the resources of edge storage devices are heterogeneous.Ensuring the efficient use of resources and the effective storage of data is the primary problem.Secondly,the edge devices are geographically dispersed,and it is not necessary to hire a large number of operation and maintenance personnel to maintain and protect the devices.In reality,it is easy to lose data due to failure or malicious damage,which will cause the device to go offline.In addition,edge storage devices usually belong to small organizations or individuals with limited operation and maintenance capabilities,which further reduces the reliability of edge storage devices.Its characteristics of different owners also make it challenging to find a third party who all nodes can trust as resource dispatchers or data managers.This article starts with the edge storage system’s storage reliability and data reliability,realizes the high reliability of data storage,efficient data access,and decentralized data distribution.Besides,it also presents the edge storage system of the audit scheme with an in-depth study of the efficient use of heterogeneous resources nodes.Then we give edge storage solutions that take both the interests of all parties’ reliability of data storage into account.And at the same time,in-depth research on decentralized edge data distributed storage solutions is also proposed to ensure data storage integrity.The main research content and contributions of this paper are as follows.Firstly,a data distribution and migration scheme that considers the heterogeneous resources of storage edge storage devices is proposed.Specifically,a data edge storage architecture for smart cities is first proposed.Then the heterogeneous resource situation of edge storage nodes is modeled for this scenario to optimize data distribution strategy under constraint conditions.At the same time,file migration restrictions are given to the difference in file access heat to ensure efficient storage of data.Experiments show that,while ensuring high-reliability storage,the migration and distribution scheme we propose can effectively use heterogeneous devices to achieve efficient data storage.Secondly,a data distribution scheme based on the credibility of base edge devices is proposed.Specifically,define and quantify the credibility of edge storage devices,and then apply the subnet division mechanism to combine credibility to layer all edge storage devices.The storage devices can be divided into the core edge devices composed of high-reliability devices and the common edge device storage layer composed of lowconfidence devices.User data are stored in different storage tiers by classifying and erasing the importance of the data.The same data can also enjoy hierarchical storage services by extracting summary information.Experiments have shown that reliable data storage can be achieved through tiering.The proposed storage mechanism can improve the access efficiency of critical data and save storage costs.In addition,by applying different proportions of data redundancy at different layers,The proposed storage mechanism can effectively reduce storage costs and data repair costs.Thirdly,an edge data distribution mechanism oriented to resource dynamic game is proposed.In the edge storage scenario,individuals or organizations add surplus storage resources to the edge storage network for the purpose of obtaining benefits to provide storage services for other users,and realize the elastic expansion of the edge storage system.By constructing a game between the storage service provider and the demander,bidding based on smart contracts can maximize the benefits of multiple parties,realize the decentralized storage of data from the perspective of data distribution,and improve the reliability of data storage.Experiments show that the game-based decentralized auction mechanism is feasible and efficient and can realize the effective decentralized storage of data in geographic locations and avoid data loss caused by data block aggregation.Finally,we propose a decentralized edge data integrity audit mechanism.Specifically,we use blockchain smart contracts as a trusted third-party audit platform to manage the composition of the audit committee and the decision-making of audit results.Then it can distribute audit tasks to the audit committee in the form of crowdsourcing and design a suitable incentive mechanism to make all members of the audit committee have to tell the truth to get the most benefit,to ensure the reliability of the audit results.The results submitted by all nodes participating in the audit task are finally analyzed through game theory to prove their credibility.The realization of smart contracts demonstrates the feasibility of the decentralized crowdsourcing audit mechanism.The performance analysis of the audit process and the analysis of the task volume of the edge device audit also show that crowdsourcing audit has lower resource overhead.