Research Of Sea Island Remote Sensing Data Storage And Management Based On The Cloud Services

In recent years,with the development of observation technologies,the storage capacity of ocean remote sensing data is growing geometrically.At the same time,the application of sea island high resolution remote sensing data are increasingly prevalent,and various applications of compute-intensive and data-intensive come forth constantly.Thus,the traditional storage managements for remote sensing data are increasingly difficult to meet the demand.The efficient storage of growing massive remote sensing data,and on this basis the flexible,reliable management and application services are provided based,are pressing problems desiderate to be solved in the remote sensing data storage and management field.In order to solve the challenges of the storage,management and application of the dynamically growing high-resolution remote sensing data,the cloud computing with low-cost and highly scalable is a most potential solution.In this paper,on the basis of the open source cloud computing platform Hadoop,combined with high-resolution remote sensing data storage and application characteristics,the applicaiton of the two main characteristics of cloud computing,including distributed storage and high-performance parallel computing in high-resolution remote sensing data storage and management is researched.Thus,the Cloud-RDSM,a cloud services oriented storage and management application model of remote sensing data,is put forward to implement the efficient storage,management and data transfer of high-resolution remote sensing image data.The following three aspects of research work have been done in this paper:1)The characteristics of the cloud storage distributed file systems and the remote sensing data access by space region are analogized,and the problems of the application of the distributed file system in remote sensing data storage and management are pointed out.An imagery storage module called Distributed Imagery Dataset(DID)is put forward to settle the problems in the remote sensing data cloud storage.In the combination of the module and HDFS,an open source distributed file system of Hadoop platform,the distributed storage and retrieval of imagery data are implemented,and the ability of spatial data access of the remote sensing data cloud storage is introduced.2)Based on the analysis of access interface of the distributed file system HDFS for cloud storage,an image data transfer mechanism based on network connection multiplexing(NCM)is put forward,and the efficient transmission of large-scale image data blocks for distributed image dataset is implemented.Thus,the technical foundation for efficient image data dissemination is provided.Experiments and analysis show that the system can maintain a high throughput in multi-user concurrent access,have a good scalability,and able to provide efficient image data resampling and image data block transfer for low-cost,highly scalable remote sensing data cloud service to provide technical support.