Research And Implementation Of Storage Virtualization Based On Ceph Distributed Systems

With the increasing demand for large-scale data storage in the modern society,the traditional storage architecture has limitations in terms of disaster tolerance,scalability,and maintenance management,which results in additional costs for enterprises.To solve these problems,this thesis fully combines distributed storage systems and storage virtualization technology,and designs and implements a virtualized storage system based on distributed systems.The main functions include storage resource management,logining security authentication,and data interaction.The main work of the thesis includes the following aspects:(1)Design and implement a storage resource management module.This module integrates heterogeneous storage devices,manages physical storage resources in a unified manner,provides users with a logical storage resource pool,allocates logical storage volume space according to user application requirements in the resource pool,and map the data space on the logical volume to the underlying object collection with the consistent hashing algorithm.At the same time,the system can be expanded to hundreds or even thousands of nodes.When the physical resources fail,the system can quickly recover the failure data and achieve high availability.(2)Design and implement a module for logining authentication.This module implements the storage side's identity authentication to the user.When the client connects to the storage side,three-way handshaking periodical identity verification is performed,and the MD5 encryption algorithm is used to avoid transmitting the user's real password during the verification process,thereby increasing the security of the system.(3)Design and implement a module for data interaction.The module is responsible for establishing an iSCSI session between the client and the storage,parsing the data packets transmitted from the iSCSI session,and moving the parsed commands and data to the underlying distributed storage systems for I/O.Finally,the system test results show that among several factors affecting storage performance,the file access mode has the greatest impact on the storage system throughput.At the same time,the peak value of the storage system throughput obtained from the test data is 62,461,161 KB/s.The storage virtualization system has been released by H3 C Technologies Co.,Limited.It is an important component of the private cloud services provided by H3 C for the enterprise,which helps enterprises transform from traditional storage environments to multi-node virtual storage systems and take full advantage of existing storage resources.