Application Research Of Ecological Pig Farm Data Management Technology Based On Distributed Storage

Big data management is one of the key technologies for smart and ecological agriculture.Traditional centralized data management has disadvantages such as low read/write efficiency and poor scalability in big data storage and processing.These shortcomings restrict the promotion and application of centralized databases in the field of big data.At present,many Internet companies and e-commerce platforms have been well managed for the management of big data.However,low-cost,low-energy,high-reliability storage solutions for agricultural big data management are basically not available.Distributed databases are one of the primary solutions for big data storage and processing.It builds a distributed cluster to slice the data in the centralized database,then distributes the data to each fragment node,and finally realizes the storage and processing of big data through the collaborative work between the nodes.However,the distributed storage of data leads to the operation of data often needs to be carried out across nodes,which will increase the complexity of data processing.Therefore,in practical applications,middleware is usually used as a proxy to implement distributed storage architecture design.It manages the underlying physical database through middleware,and virtualizes the underlying database into a database for upper-level users,which can ultimately reduce the the complexity of the distributed database.This dissertation analyzes the current mainstream distributed data storage scheme.Based on this,the Mycat distributed database middleware is introduced.Combined with the specific requirements of the farm management system storage expansion,the distributed data storage design and implementation scheme based on Mycat is proposed.The specific work of this dissertation is as follows:(1)A detailed theoretical study of distributed storage was conducted.A distributed storage solution is proposed for the problem of centralized storage in data management of ecological pig farms,and the segmentation rules and segmentation methods of distributed databases are analyzed in detail.(2)Choose Mycat middleware to implement distributed database architecture and perform performance testing.Through the analysis and comparison of the advantages and disadvantages of distributed middleware on the market,Mycat is used to realize the deployment of distributed database,and it carries out load test and read and write test under high concurrency,and determines the situation of high concurrency and massive data.High performance of distributed databases.(3)The practical application of distributed storage is realized in combination with the business requirements of the farm management system.The demand analysis of the storage expansion plan of the farm management system is carried out.According to the demand analysis,the data segmentation,cross-slice query,read-write separation and high availability in the distributed database of the system are designed,and a set of piglets for the pig farm is designed.A distributed storage solution based on Mycat implementation for motion monitoring.This dissertation proposes a distributed data storage scheme implemented by Mycat,using MySQL as a physical database,integrating Mycat as a middle layer to integrate physical libraries,and providing distributed database services to upper-level users.This solution minimizes the impact on applications while enabling distributed data storage.Finally,the scheme was used in the farm management system to verify the feasibility of the scheme.