Distributed Parallel File System Log Management

In this paper, we propose a new paradigm for network file system design, DPFS (Distributed and Parallel File System). While traditional network file systems rely on a central server machine, Any machine in the system can store, cache, or control any block of data. Our approach uses this location independence, in combination with fast local area networks, to provide better performance and scalability than traditional file systems. Further, because any machine in the system can assume the responsibilities of a failed component, our design also provides high availability via redundant data storage. Availability is a key challenge for a distributed system such as DPFS. Because DPFS distributes the file system across many machines, it must be able to continue operation when some of the machines fail. To meet this challenge, it builds on log recovery mechanisms, the keystone of which is redundant. Log system is the foundation of fault-tolerance in distributed file systems. In addition, log can be used to maintain consistency among duplicates. Log has become the most popular and dependable technique to maintain system reliability.The balance of this paper is organized as follows. We view the development of network file systems. It also introduces the design of the distributed and parallel file system and presents the architecture of a quality DPFS. Besides the efficiency it provided to log manager system during failure-free time, this log mechanism will considerably improve the performance of transaction process and log-recovery protocols. The last chapter draws the conclusion and makes expectation for the future research.