Design And Implementation Of Internal Data Communication Of Intelligent Water Meter System Based On Kafka

With the arrival of smart cities,smart water has also become a very important proposition.For water supply companies,how to manage water supply efficiently and conveniently and charge smartly has become an important part of the current information construction.As a solution to the above problems,the intelligent water meter system in this paper is emerged naturally.The intelligent water meter system is divided by design concept into four components,namely,a Web management module,a data acquisition module,a data storage service,and a data transmission service.The modules are mutually independent and do not affect each other.This design reduces the internal coupling within the system.The existing data transmission service scheme is based on a data sharing method,and there are some differences in message command transmissions between the Web management module and the data acquisition module.So,these existing programs can’t effectively solve the following problems:1)We need the efficiency and reliability data transmission and data can be processed online or offline.2)The pressure from reading and writing database is large,and it can affect the data storage operation and other function of system.In order to solve the above problems,the work done in the paper includes:1)Through the technical selection of communication schemes and message queues,the final decision is to use Kafka as the message middleware of internal data communication of the intelligent water meter system.2)In combination with the intelligent water meter system,implementation scheme for producers and consumers,data transmission scheme,and parallel message processing scheme based on the Kafka message system are designed.3)After applying the Kafka message system in the intelligent water meter system,this paper conducts stress tests on the throughput of the Kafka producers and consumers,and provides experimental basis for the parameter setting of the intelligent water meter system.This paper finally applied the Kafka message system to the intelligent water meter system to improve the data transmission and processing efficiency of the entire system,and achieved independent parallelism between modules.It also ensured the real-time nature of the entire system data information and enhanced the reliability and fault-tolerant of the entire system,and it obtains good results.