Operation Training System Of Printing Machine Based On Mixed Reality

With the advancement of Industry 4.0,the operation training of industrial equipment is more and more combined with information technology,and the application of mixed reality technology to training in the industrial field has become the current development trend.Based on HoloLens equipment,this paper uses MRTK and Unity 3D as the development engine to design and develop a printing press operation training system based on mixed reality.Compared with the traditional virtual operation training system,its multi-modal interaction method truly liberates the hands of the trainees.The novel virtual and real operation training program enhances the students’ learning interest and realistic experience,and improves the efficiency of operation training.The main work completed and results obtained in this paper are as follows:(1)Build and process models,and design simulation animations.In 3ds MAX,the original printing machine model is modified in size,the printing machine model,the left control panel and the main console model are constructed 1:1,which are used for the fusion of virtual and real to design the simulation motion animation of the main components of the printing machine,and the simulation motion animation of the main components of the printing machine is designed.Build a three-dimensional model of the plate cylinder and blanket cylinder in SolidWorks.Optimize each model in Unity 3D to solve the stuck problem when the HoloLens device is running.(2)Research the key technologies of virtual and real integration of printing presses.Analyzed the realization principle of three-dimensional tracking registration with logo,and intuitively compared the recognition efficiency of ARToolkit and Vuforia,and finally formulated and realized the technical route of applying Vuforia and HoloLens’ SLAM and spatial anchor technology to realize the virtual and real fusion of the system.(3)Research the human-computer interaction technology in mixed reality scenarios,and use the MRTK engine to establish a diversified human-computer interaction mechanism in the training system,such as gaze tracking,gesture recognition,voice interaction,and spatial sound effects.(4)Based on the actual needs of the trainees,a complete printing press operation training system based on mixed reality technology was designed and implemented.Designed a user-friendly GUI interface,focuses on the development of the following modules:①The printing machine simulation learning module integrating virtual and real.Through this module,users can better understand the working principle of the printing press by viewing the composition structure and simulation motion animation of the printing press;②Equipment interactive learning module.Before each process training,trainees can learn the basic knowledge of mechanical equipment through holographic video and text,and realize the zooming,rotating,resetting,moving,and dismantling operations of process equipment components through voice interaction and gesture interaction.Understand the structure of the equipment;③Virtual and real integration operation training module.In this module,the virtual equipment is integrated with the real equipment,and users are guided through operation training through holographic video teaching,text teaching,voice prompts,operating parts highlighting,operating animation demonstrations,expert remote guidance,etc.,and a score evaluation mechanism is set in the boot printing process training module to monitor the training in real time.The operation behavior of the personnel is given a score evaluation.The developed training system is deployed on HoloLens equipment and tested and evaluated.The test results show that the system in this paper runs smoothly and achieves a better virtual-real fusion effect.Users can use diversified interactive means to naturally operate the training system,which is true to the operation of the equipment.The sense of experience is stronger,and the training effect is significant.