Research And Application Of Multi-source Heterogeneous Data Real-time Processing Technology For Industrial Equipment Monitoring

With the rapid development of current science and technology,information construction is also rapidly advancing and applying in the industrial field.Especially in the monitoring of industrial equipment,due to the large number of monitoring items,it is necessary to access various types of sensors,resulting in the resulting data.It is located in different data sources and has heterogeneous features in terms of semantics and data formats,which brings great inconvenience to the management and analysis of related data.Therefore,an integration and processing scheme for a large number of multi-source heterogeneous monitoring data is proposed.It is very necessary to ensure the integrity and timeliness of the data while solving the differences of heterogeneous data sources.The existing data integration technology is not flexible enough,and the timeliness performance is also worse with the increase of the amount of data,so there are great limitations in the application field.However,in the monitoring of industrial equipment,there are many industrial devices,the monitoring data is complex,the monitoring duration is long,the data accumulation is large,and at the same time,the business needs are diversified.It is necessary to integrate the monitoring data of different devices and perform a series of processing on the data.And the use of reliable storage technology to provide a fast and effective way to query,to achieve the intelligence and information in industrial equipment monitoring.This paper presents a multi-source heterogeneous data real-time processing model aiming at the problems existing in the field of data integration,combined with the characteristics of industrial equipment monitoring data.This model adopts XML data representation to analyze the mapping mechanism between XML documents and databases,realizes the conversion of heterogeneous data,and adopts improved Bayesian estimation inference for the uncertainty of the data measured by multi-source sensors.The method realizes data fusion to improve the authenticity and reliability of the measured data.In order to ensure the real-time processing requirements of the monitoring data,the latest data collected by the sensors are stored in the local real-time database during the data collection process,and the processed data is stored in the server's historical database for further analysis and query.Ensure data consistency during storage.And Then the multi-source heterogeneous data real-time processing model is used to complete the development of real-time monitoring system for Dalian LNG receiving station equipment.Based on the software engineering idea,the system is completely analyzed and designed and its function is implemented.The system can be effectively completed.Related equipment data monitoring and full-cycle real-time fault diagnosis,and provide a rich query interface and visual interface for different processing needs.Through practical application,it is proved that the model presented in this paper is applied to actual business scenarios,and it can ensure the integrity,real-time and reliability of the data.It has great practical significance in improving the efficiency of real-time processing and information.