A Quasi-real-time BBS Detection Technology Research And Implementation Of Public Opinion

Monitoring public opinion is currently an important task at all levels. By monitoringpublic opinion, to obtain an accurate trend of public opinion has become must be done.BBS as an important channel of information dissemination currently, in the mass media ofstudents played an important role, monitoring of specific areas of public opinion researchfor BBS is Very meaningful work.The current technology for public opinion on the BBS to detect is mostly divided intotwo areas: On the one hand, focused on the campus network boot strategy of publicopinion research; On the other hand, focused on BBS of public opinion analysis system.Existing public opinion monitoring system based on the information collection andanalysis methods mostly used generic search engine technology. This approach isproactive method of collecting information, information collected over the whole. Butthere is a long cycle of information collection and more duplicate content problems, whichcan’t meet the new situation, real-time, efficient and accurate new demand. So, this paperpresents a way to quasi-real-time detection of information technology BBS opinion. Thetechnology designed system architecture from of three aspects: the data acquisition, datapreprocessing and data analysis. First, it extracted architectural characteristics of BBS andproposed a quasi-real time data collection method. Then, it used tool of HtmlParser toinformation pretreatment and used tool of Solr to build search engine for database. Last, itget a complete monitoring system which contained three main functions of hot spotsanalysis, public opinion of extraction and early warning analysis.Quasi-real-time system can monitor the university BBS, accurate access to specifiedcontent, efficient retrieval of data collection, and then tap the hot event. Study not only canbe used in colleges and universities to monitor public opinion, it can also be easilyextended to the mainstream public opinion of forum monitoring system. The currentsystem has been used to for some time, reflecting it good.