Research And Application Of Virtual RAID Technology In Big Data Storage

With the increasing size of big data storage,the high energy consumption,security,data management which has become more serious,so the study on the energy saving,data Security,and other data storage utilization become more and more important.This thesis presents a virtual disk group technology,and designed a large data storage systems.It can achieve energy savings,safe,efficient management,through parallel processing tasks and consolidation and storage of data by the data disk group.This thesis presents a big data storage system architecture,which consists hardware and software design.It proposed node management in the framework of the software system,which realizes multi-channel parallel data storage,it greatly improves the efficiency of the Data Storage.On the basis of combination of RAID technology,this thesis proposes a Virtual RAID technology,Generate data disk group by a seed file,it can achieve burn the data to CD library.After data Storage preprocessing,add task information to the seed file,the data storage tasks make up a data disk group.The Store thread calls delete algorithm to ensure the buffer size large enough.when the end of the Data disk group,the data distributed to each free node by Node server,it can achieve burn the data to CD library.The data is stored into offline storage when storage space is insufficient.It is not only save energy and safety,but also improve the management efficiency.In order to improve the compatibility of the service side,big data storage system uses B / S structure to reduce the coupling client and service side.It rewritten ODBC database connector for compatibility with multiple databases.It supports a variety of web interface.Through the actual verification at Xichang Satellite Launch Center,this system has been full affirmed on its safety,practicality,stability and efficient management.Big Data Storage system has a great significant on video,files,bank so on.