A Study And Design Of A Hybrid File System For Energy Efficiency And Reliability

At present,the storage capacity of data centers has increased year by year,as well as the energy consumption.Although researchers keep study on energy efficiency,energy efficiency storage technology still faces many problems.First,the energy wall and the reli?ability wall is unavoidable.Second,it is difficult to ensure the stability of the system while retaining energy efficiency.This thesis proposes a hybrid storage system and implements a corresponding prototype system based on energy efficiency and reliability through analysis of existing technologies and utilization of open source systems.First,this thesis proposes and designs a hybrid storage solution for energy efficiency and reliability.This proposal seamlessly integrates SSDs-based file systems and HDDs-based file systems,and provides data access support for applications through a unified middle-layer system.Because the two file systems are independent of each other,they have little effect on system reliability.The proposal can also distribute data to different file systems according to the frequency of data access,so as to achieve the purpose of acceler-ating file reading.In addition,node-level energy savings can be achieved by adjusting the power of the node where the file system based on the HDDs is located.Second,this thesis implements a prototype file system for the hybrid storage proposal.The core of this system is a user-space file system,which is mounted on the operating system by FUSE so that the POSIX interface can be provided to the user.On the other hand,the data can be stored in the physical devices through calling the interface of the underlying parallel filesystem.This system is configured with two underlying parallel file systems.One is an SSDs-based parallel file system,which can store data which have a high access frequency.The other is an HDDs-based parallel file system.It is used to store data which have a low access frequency.When the workload of the system is at a low level,the HDDs-based file system can be adjusted to a low energy consumption status to achieve the effect of energy saving.The results of the experiment shows that this system meets the design expectations basically.The preliminary results shows that compared to the control group,the bandwidth of this system is increased by about 60%.In terms of energy efficiency,this system can save about 30%-40%of energy consumption when providing the two underlying file systems provide data access support at the same time.If only provide support for high-frequency access data,it can save more than 70%of energy consumption.Due to the adoption of power-saving measures,this system pays a cost of approximately 15%in reliability.