Development Of A Long-term Monitoring Terminal Based On MQTT Protocol And Gzip Compression Algorithm

Long-term monitoring refers to the comprehensive monitoring of the stable operation of a system,equipment or environment over a long period of time through data collection and analysis.The purpose of this monitoring is to obtain more accurate,comprehensive and real-time data information,thus helping people to better understand and predict the performance status,change trend and possible failure risk of that system.With the development of industrialization and urbanization,long-term monitoring systems are becoming more and more important;however,as the operation time of monitoring systems grows,the size and volume of monitoring data increases,creating a tremendous amount of work for data management,storage and analysis.Therefore,when facing the problem of data transmission,it is an important challenge to reduce the storage space occupation and enhance the data transmission speed by how to compress and efficiently transmit the data according to the data characteristics.In order to solve the above problems,this paper designs a long-term monitoring terminal based on MQTT protocol and Gzip compression algorithm,and tests the terminal performance,with the following main research contents and conclusions:(1)A data compression algorithm and MQTT transmission scheme for long-term monitoring terminal are proposed.the Gzip compression algorithm is composed of two sub-algorithms,LZ77 and Huffman,in which the LZ77 algorithm achieves compression by finding repetitive sequences in the data,and the Huffman coding algorithm achieves compression by assigning codes according to the frequency of data occurrence;the MQTT transmission protocol uses EMQX,the open source server of EMQ,and the Eclipse Paho client are implemented,and the installation and theme setting of the C++ library in MQTT are completed.(2)According to the long-term monitoring requirements,the overall structure of the terminal is determined as a three-layer design with data acquisition layer,network communication layer and user management layer.The designed hardware consists of the main control module based on Nano Pi R1,data acquisition module based on GC-97001 C fiber grating demodulator and communication module based on USR-G800 V2,and the power supply scheme based on wind and solar energy is designed;the software design of the terminal is realized by C++ and VS development platform,which has the functions of data acquisition control,data upload,data The software design of the terminal was implemented by C++ and VS development platform,which has the functions of data acquisition control,data upload,data cache retransmission and data replenishment.(3)The test platform of the long-term monitoring terminal was built and the performance of the terminal was tested.The results show that: the power consumption of the whole machine is 22.2W in the limit working condition,which can realize self-powering for 3 days;the transmission data is complete and error-free compared with the signal source;the transmission time is shortened by 35.83% and the data loss rate is reduced by 39.60% compared with other transmission solutions;the compression rate of the terminal is controlled below 11.97% and the compression and decompression efficiency is high,which effectively saves the transmission bandwidth;and the terminal is applied to the actual project.The error of the roping force calculated by monitoring data is less than 8%,the average data loss rate is 0.85%,and the average transmission time is 0.77 s,which proves that the terminal has good accuracy and reliability in engineering practice.In summary,the long-term monitoring terminal developed in this paper for long-term monitoring has the advantages of high data compression rate,fast transmission speed and small data loss rate,which has a good market prospect and can be widely used in the field of long-term monitoring.