Design And Implementation Of Open Distributed File Storage Service

With the explosive growth of Internet data, the demands of Internet applications for data storage increase quickly. Due to various restrictions,traditional data storage is more and more difficult to adapt to the changing requirements. However, distributed file systems, in terms of their incomparable advantages on reliability, scalability and performance,become more and more popular. At the same time, distributed file systems are complex in their implementations. That’s the opposite of developers’desire to shorten the development cycle and reduce the development complexity in the fierce Internet competition. With distributed file storage services, third-party applications could easily integrate the ability of distributed file storage, thus to simplify the development process by ignoring distributed file storage technical complexity.In this paper, the distributed file storage service based on Cloud Storage is designed and implemented, which provides open RESTFul APIs for simple file storage service, object gateway service and block device service. The service allows developers to integrate the ability of distributed file storage into their applications conveniently. In addition, this service provides web portal for developers and service administrator. Developers could manage files and block devices and service, register object gateway service. Administrator can manage user accounts and registered applications through the web portal, visually monitor and manage distributed file system cluster.Firstly, the research background of this paper is introduced. Based on the investigation and comparison of the existing distributed file systems,the functional and non-functional requirements for open distributed file storage service are brought forward. Secondly, the design and implementation of the open distributed file storage service based on Ceph is specified in detail. In the end, tests and performance optimization of the open distributed file storage service are illustrated. Tests and the sample application verify the effectiveness of the service.