Research And Implementation Of Data Collection And Trusted Technology In Network Communities

More and more people express their views through the communities on the network.It has important significance to collect and analyze the views and opinions expressed by users.However,the current data collection and analysis system is not trustworthy because of the incomplete,discontinuous and untrue data.This paper mainly studies the data collection technology and the related trusted technology mechanism of the network community,and explores how to improve the credibility of the data collection framework from multiple levels.According to the data collection requirements of the network community,a distributed data collection architecture is designed and implemented from the three aspect of web data collection,data packet capture and interface call collection.And a rapid development framework for rapid web development of different sites is developed.Based on the data storage requirements of data analysis,the storage schemes of structured data,real-time hot data and web snapshot data are designed respectively.The trusted technology related to data collection in this paper is studied from four aspects:sustainability,immediacy,integrity and authenticity.And a credible module is designed and implemented to improve the credibility of data collection.Finally,on the basis of research and implementation,this paper presents a measure model of the credibility of the network community data collection,and realize the data collection technology and the credible technology mechanism for many typical network communities.The test results show that the implementation of the trusted data collection framework can effectively guarantee the credibility of the network community data collection.