Research And Development Of Assembly Simulation System Based On Gesture Interaction

Although the current assembly simulation system can bring the user into the virtual environment,it still requires the user to hold the auxiliary equipment to perform the corresponding operation,which is a burden for the user.With the continuous advancement of virtual reality technology,people are no longer satisfied with the current interactive experience and put forward new requirements for interactive methods.In response to this demand,this topic uses a manipulator claw used by a company in Ningxia as the assembly object,and develops an assembly simulation system based on gesture interaction with the aid of the virtual reality auxiliary device HTC Vive.In addition to learning the disassembly and assembly process of the claw in the virtual environment,the user can also use gestures to manipulate parts to conduct the disassembly and assembly training of the claw,which enhances the experience of human-computer interaction.There are two main tasks completed in this subject:1.Carry out three-dimensional modeling and assembly process design for the assembly object of this subject-the manipulator claw.Since the manipulator claw contains a large number of parts,the manipulator claw is split by analyzing its structural characteristics,and then the modeling software Solid Works is used to create a 3D model according to the real size of the components of the manipulator claw,and import it into the rendering software 3DS Max for re-rendering and optimization,and finally plans the interactive disassembly and assembly operations with reference to the assembly process of the manipulator claw.2.Design and realization of human-computer interaction.According to the characteristics of the disassembly and assembly interaction of the manipulator claw in the virtual environment,the interaction requirements of the system are analyzed,and a set of interactive gestures is designed,including characters roaming in the scene,human hands grasping,moving,releasing,rotating and switching scenes and other operation gestures,and introduce the design and realization of each gesture in detail.