Design And Implementation Of The Intelligent Agriculture Large Data Aggregation Platform Based On Rule

Data is the end of the wisdom of human settlement,is the center of knowledge,is the people in the natural activities of the natural law and the results of the study of the collection.Big data refers to a large number of data collection results set.Now generally refers to the use of IT and related information to the means of the traditional people to explore the nature of knowledge and wisdom that the precipitation of the collection,and then use the computer's ability of high-speed computing the ultimate role in our life.In today's information explosion today,the value of big data has been more and more attention.More and more industries will be grafted in the big data sector.For agriculture,its development,to today has produced a lot of experience and wisdom.If these experiences and wisdom into big data,then the future development of agriculture as a whole will be extremely favorable.Thus,the study of large data aggregation platform for agriculture will be extremely valuable.However,due to the huge amount of data on the Internet,the species is extremely large,many data are invalid data.Therefore,this paper studies the related theory of intelligent agriculture data aggregation and technology,proposes a fast access to effective agricultural data structure and mechanism,the design and implementation of intelligent agriculture data aggregation platform based on rules.The main research contents and results are as follows:(1)The design of high performance network spider.Taking into account the huge amount of Internet data,in order to be able to obtain efficient agricultural data,based on the multi task concurrency mechanism,this paper designs a high performance network spider.In this process,due to the frequent large data storage,will cause the memory fragmentation,reduce operating system performance,so intelligent garbage collection mechanism of memory based on the design of intelligent agriculture data aggregation platform and data memory pool general storage object.The core components of the high performance network spiders including: memory pool,general store object,configuration manager,URI standard module,data acquisitiondevice,intelligent filter,rule URL recognizer,crawling queue,encoding converter,filters and other special characters of 11 sub modules based on.(2)The intelligent agriculture large data aggregation platform based on rule is constructed.Because the Internet data types and complex,this paper designed the agricultural expert system based on rules to judge the validity of data,accurate data related to agriculture in the Internet are aggregated to invalid data independent of the exclusion of agriculture.The characteristics of agricultural expert system knowledge base construction based on the logical relationship between agricultural characteristics in the knowledge base and based on the basic data obtained in the high performance network spider through it to the intelligent filter.Finally,the realization of a large,complex data in the Internet can effectively aggregate agricultural data related to large agricultural data aggregation platform.