Research And Implementation Of Public Opinion Data Extraction Technology Based On Template

Today the network has been populated,the data and information carried by the Internet also developing in a diversity way.The number of data and information can not be stored by one computer.However,it has become an urgent problem need to solved that how to quickly get information about public opinion data that users are interested in among such diverse and massive information.For this question,this paper put forward the template-based public opinion data extraction technology and based on this technology,this paper realized the public opinion data extraction system that meets the customers’ needs.This paper respectively from the semi-automatic and automated directions proceeds data extraction that the users interested in.In this paper,the functions of the system are realized,such as semi-automatic template generation,automatic template generation,automatic data extraction,using templates timing automatic extraction,and efficient shunt extraction.Practically,the system according to the actual needs of users to achieve design.In the aspect of template generation and data extraction,This paper is presented and implemented the public opinion data template item generation algorithm,public opinion data template generation algorithm,preserving noise removal and public opinion information location algorithm,automatic public opinion data extraction algorithm,automatic template generation algorithm.These algorithms in the public opinion data extraction system not only has played an irreplaceable role,but also make the function of this paper system more comprehensive and easier to achieve.In addition,because of the mutual substitution of these algorithms at different stages,the system has good robustness,such as the failure of the template generated by the public opinion data template generation algorithm due to the site upgrade.At this time,the automatic public opinion data extraction algorithm and automated template generation algorithm will be replaced,that does no effect on the normal extraction of data and also able to automatically update the template in a timely manner.After testing,all the functions and performance of the system meet the needs of users,all the algorithms proposed in this paper are also effective.