Research And Implementation Of Augmented Reality For Assembly Teaching And Assembly Guidance

Traditional assembly teaching and assembly guidance usually adopts a way of "paper-based assembly document with manual guidance",which is cumbersome and time consuming.Three-dimensional models involved in this process are only used at the designing stage of the product,not fully utilized at the assembly teaching and guidance stage,which potentially deteriorates assembly error rate.At present,there exists augmented assembly system that fulfil assembly teaching and assembly guidance,but seldom considers human-computer interaction from the perspective of users,which builds a barrier to effective and smooth human-computer cooperation between users and the system.Augmented reality（AR）technology is integrated into real-world scenario in the study,in particular,with the introduction of transparency theory,a user-oriented augmented assembly system with assembly teaching and assembly guidance as the main functions was proposed.The main works in this thesis are as follows:1.Aiming at the problems of low efficiency of assembly guidance process and large error in assembly results,a tracking registration method based on the combination of Oriented FAST and Rotated BRIEF（ORB）algorithm and Kanade-Lucas-Tomasi（KLT）sparse optical flow method is proposed,where the improved ORB algorithm is used for feature extraction and description.The proposed method shows a increase in feature point matching rate of 4.9% when compared with the original ORB algorithm,which meets the requirements of the system for real-time and accurate tracking registration technology,and provides technical support for the construction of augmented assembly system.2.Aiming at the problem of low users’ trust in the existing augmented assembly system due to low transparency,a human-computer interaction design of augmented assembly system is carried out based on transparency theory.Transparency models are introduced into the human-computer interaction design of the assembly system.A transparency level model is established.A user-centered human-computer interaction process is designed.The main purpose of these actions is to make the assembly guidance and assembly teaching more efficient and smoother.Compared with the way of traditional assembly manual,the average score of availability under the proposed system increases by 21.7,improving the users’ trust to the system.3.A set of augmented assembly system with assembly teaching and assembly guidance as the main function applicable for HoloLens 2 is built,whose tracking registration and human-computer interaction modules are improved.The system is verified with a phase control model as research subject,and the efficiency of assembly teaching has improved by 45.5%,the efficiency of assembly guidance has improved by29.5%,which shows the effectiveness of the augmented assembly system in assembly teaching,assembly guidance.The effectiveness verification of the augmented assembly system developed in this thesis for assembly teaching and assembly guidance provides a new idea for the in-depth research and implementation of the augmented assembly system.