File Fast Transfer Protocol Based On Types Of Files Among Clusters

In recent years, the rapid development of computer technology and the computer network related industry has brought numerous data. It brings a lot of challenges in data processing, in which data replication synchronization and move from multi nodes becomes a key technology. Due to the heterogeneity of computer networks and the diversity of computer network related applications, a large amount of data has been stored in the hard disk, which becomes a problem for copying and moving the data among distribute nodes in the clusters.The traditional approach to move the data or file is limited. Reducing the amount of data by compression is one of the traditional methods in data processing. The traditional methods have little effect on enhancing the efficiency of file transfers. It is necessary to develop a kind of file-sharing protocol which is applied in the communication among network clusters. This protocol focuses on optimizing the process of data transmission, and reduces the overall transmission time by designing appropriate strategies and algorithms which reduce the overall time of transfer files among different nodes.The content of this thesis is on the basis of common distributed file system theory,and to make a difference between file sync treatment as a strategy, in addition, by means of distinguishing and optimizing for network clusters in different network topology, to attain the synchronization of inner clusters, and, to obtain an optimal efficiency and reliability of synchronization between clusters or, the communications between cross-domain single point to clusters. In the application and practice of distributed file system, we could find that the efficiency file distribution and migration efficiency seriously influenced the overall efficiency of the task, especially in the case of network bandwidth constraint. Synchronization between clusters can only start after the transmission of the network through a single point terminated. Hence, we can contribute to a huge promotion effect on overall performance by speeding up the efficiency of a file migration process. Based on basic research and the analysis of the common distributed file system, this thesis improves the file synchronization strategy,and proposes the corresponding optimization according to different network topologyand the cluster scale. The experimental results demonstrate the proposed methods improve the efficiency of data move and transmission among network clusters.