The Agent-Based Intelligentizing Search Engine System

By a deep analysis of Web crawling, file process, Chinese words segmenting, Index building, for some faults to waste some network resource owing to filtrating after downloading, it is designed the new search engine of professional information. The system was improved on Web crawling, Chinese words segmenting and Index building sub-system in order to realize a function to estimate correlative rate between a web site and chemical specialty and all of sub-system are able to work compatibly.The system maintains a KBS in which includes some chemical specialty distribution situation in Internet space. At the first time a system runs, it can analyze some situation on how professional information distribute in a web site in order to get a correlative rate. Since then, based on correlative rate in KBS, it ensures that more advanced rate a web site has, earlier it can be visited.The Agent Technology upgrades the system. Since that, it ensures that some sub-system of Web crawling, which works in some different...