Development Of AR Toolkit For Complex Equipment Maintenance

Augmented Reality（AR）technology is a technology that can render computer-generated virtual information in the real environment,which can enhance people’s perception of the real environment.The method of applying AR to equipment maintenance guidance can enhance maintenance worker understanding of the maintenance process,reduce cognitive burden,and improve maintenance efficiency.At present,if manufacturers of production equipment want to develop an AR system for maintenance guidance,they need to spend a lot of energy on it.It is difficult for technician who are proficient in equipment maintenance to develop AR system for maintenance guidance due to the lack of programming knowledge.Therefore,it is difficult and complex for most people to develop AR system.In response to the above problems,this thesis proposed an AR Toolkit “Development of AR Toolkit for complex equipment maintenance”.Through this tool,without programming,factory technicians who are proficient in equipment maintenance can quickly configure the key information of the AR system for maintenance guidance,and form a set of AR maintenance guidance information for specific equipment for maintenance workers.In order to achieve the above purposes,this thesis focuses on the key issues involved in the description and visual editing of AR maintenance guidance information.The main work of this thesis are summarized as follows:（1）Overall design of system.Carefully analyzed the requirements and functions of technicians and maintenance workers.According to the analysis result,designed the overall architecture and software architecture of the system.According to different users of the system,designed the system as Development of AR Toolkit running on Windows,Development of AR Toolkit running on AR Glasses and AR platform for maintenance guidelines.（2）Description and visual editing method of AR maintenance guidance information.Proposed the description method of AR maintenance guidance information,expressing the maintenance guidance information through parameters to ensure that AR system is universal to most equipment.Based the mapping relationship between screen space and world space,proposed the visual editing method of maintenance guidance information,designed the tool to change pose of model and camera.Aiming at the problem of coordinate system of dynamically imported model,adjusted the coordinates through coordinate adjustment algorithm of AABB bounding box.Aiming at the traversal problem of operations sequence described by directed graph,proposed an operations sequence planning algorithm.（3）Modification method of maintenance information with gesture.Designed the maintenance gestures.Collect the bone data of hands by Hololens2.Designed the method of hand feature extraction.Developed a system to collect gesture data.Realized gesture recognition based on template matching algorithm and improved DTW algorithm.Proposed a method for editing disassembly animation based on gesture recognition.Realized maintenance gesture recognition with a combination of static and dynamic gestures.（4）Realized the Development of AR Toolkit for complex equipment maintenance.Developed the system by Unity3 D engine.Designed the working interface of the system.Designed the method of AR information presentation,and realized the functions of 3D registration and spatial pose preservation of the models.The research work of this thesis is verified by the example of developing the AR maintenance system of automobile transmission.