Design And Research Of Heterogeneous Cloud Storage Platform Based On Blu-ray Storage

With the increasing utilization of the Internet,the quantity of data in network has grown exponentially,and IT industry has changed from storage era to computation era.Currently,most of data centers are facing problems,including huge energy consumption,low utilization of storage resources and the rising cost of storage.It is shown that the cost of storage accounts up to 30%-70% of the total cost.However,the hot data,which is used in most of time,accounts for 20%.And the cold data,which is rarely used,accounts for 80%.In this case,there is a broadly researchful and applied prospects to take advantages of devices and reduce the total storage cost,based on the identification of hot and cold data in hierarchical storage.Compared with the current development of storage media technology,CD has lower price per unit capacity than disk,and its reading and writing speed is faster than tape.Therefore,it's a practical significance that CD can be used by near line or offline storage device in hierarchical storage system.The paper establishes an “online-near line” cloud storage platform with hierarchical storage.Based on the distributed file system,the platform uses Blu-ray disc as a near line storage device.The contents of the design and implementation of the platform as follows:(1)Based on the research and analysis of the current data classified technology,the paper builds a data value model with the key features of users' behavior through the analysis of their behavior logs.The model fully considers the data value of each time by using the exponential smoothing method,and distinguishes the hot and cold data set by sorts of data value.The model can effectively improve the hit rate when the users access the data from the cloud platform.(2)It aims to analyze the strategy of data migration controlling in order to achieve the automatic and continuous data migration between the disk and Blu-ray storage.These paper emphases how to ensure the consistency of data in the migration process based on the Blu-ray disc system.(3)The low coupling design idea of the software is embodied by the realization of the platform functions through the way of dividing to sub modules.The platform adopted the method of dividing the metadata server and the application server and implementing by the division of front page and background service.At the same time,a series of tests show that the data migration in the platform is effective and accurate.It can realize the high efficiency of data transmission between the Blu-ray disc and the disk,ensure the consistency of the data,release the disk space,and improve the speed of data access.