Data Storage And Content Monitor For Broadband Network

This dissertation discusses the framework of content monitor system for broadband network, and the components of the system, includes: the load balance subsystem, capture and storage strategy for network data, the technique of access controlling for distributed data, and Multi-Protocol Assembly subsystem. In the load balance subsystem: put forward and implements the granularity partitioning scheme basing on the application session. The strategy of Dynamic Load Balance which is based on the bytes and hosts load is designed and implemented. By designing the model of "Invalidate-update", the performance of buffer is improved. In capture of network data: the libpcap function library is made more effectively, by restructuring its inner model structure, modulating the kernel buffer space and user buffer space, setting the buffer of I/O operation. Considering the requirement of the content monitor system in data storage, an effective storage strategy is brought out. In access controlling for distributed data: a framework consists of interface layer, controlling layer, accessing layer, storage layer, is designed and implemented. In interface layer, the interfaces of data accessing and managing are implemented; In controlling layer, synchronous data accessing mechanism is designed basing the "File-Lock" which is put forward. In controlling layer, uniform interface is designed to implement the local data accessing and remote data accessing. In storage layer, physical storage mechanism is design to store network data and log information data. In Multi-Protocol Assembly subsystem: the framework of libnids function library is improved. The model of daemon threads is brought in, and the framework of Multi-Protocal Assembly subsystem is implemented. The assembly technique of the pop3, smtp, http protocol is discussed detailedly, and the analyzing of mbox file is implemented. In content searching, the Implementation of the Wu-Manber algorithm is discussed.