The Industrial Equipment Maintenance System Based On Mixed Reality

The traditional equipment maintenance method relying on the manual has inconvenient searching,long time-consuming,high error rate and the other problems.The frequent switching between manual reference and repairing operation makes the repairer unable to concentrate on maintenance.It is also gradually unable to meet the needs of more intelligent and precise industrial equipment maintenance in the era of Industry 4.0.In order to improve the shortcomings of the traditional industrial equipment repairing method,promote the maintenance efficiency,reduce economic loss and ensure the productivity,Mixed Reality(MR)can be used to realize the auxiliary maintenance of industrial equipment,because of its the realistic visual experience and friendly interactive mode.An industrial equipment maintenance system using MR is designed and developed and the main tasks are as follows:(1)According to the problems in general industrial maintenance,a Mixed Reality aided maintenance system is designed and implemented,which has 5 functions: user information management,troubleshooting / diagnosis,maintenance guidance,maintenance report generation and equipment guidance training.The 3D model,operation animation,text description and other information aligned to the real environment in the system make the maintenance guidance more intuitive.It has also been successfully applied to the maintenance of a gasoline engine.(2)This paper studies the MR technologies involved in the auxiliary industrial equipment maintenance system.The point cloud data which is transformed from depth frame is transmitted to the PC server through the WLAN.The data is preprocessed.And the rough registration and fine registration are realized by the SAC-IA algorithm and the fast robust ICP algorithm respectively.The transformation matrix needs to be mapped in different coordinate system.Then the accurate superposition of the virtual model and the real equipment is realized.After the virtual model is aligned to the real device,the world anchor is added to ensure the stability of superposition.Besides,The interaction between user and the system can be realized by gesture and voice,which is much simple,natural and efficient.(3)The system was implemented and tested.Firstly,the functions involved in the MR industrial equipment maintenance system are tested.The results indicate that the system can significantly promote the efficiency of complex maintenance tasks and reduce the probability of maintenance errors.Then the performance test of 3D registration algorithm and Human-Computer Interaction method in the system is used to verify the effectiveness.Finally,the usability of the system is evaluated from the degree of understanding,learning,operating easily,fault tolerance and satisfaction.