Research And Application Of Gesture Interaction In Virtual Assembly

The research of human-computer interaction in virtual assembly is a hot spot in the current field,and gesture interaction is the most commonly used interaction mode in virtual assembly scene.After combing the research of human-computer interaction and leap motion in virtual assembly,the paper points out that the matching degree between gesture set and user’s psychological cognitive model is not high.According to the method of morpheme analysis,tasks and gestures in the scene are disassembled,and auxiliary morphemes in the scene are optimized.This paper explores the interaction gestures of 23 interactive tasks in virtual assembly scene by gesture elicitation study.On the basis of the original methods of guessability and agreement calculation,puts forward the two-hand guessability and agreement calculation method,optimizes the experimental calculation method and designs the gesture set used in the virtual assembly scene.After classifying the information in the virtual assembly scene,this paper explores the expression way of part space geometry information from the perspective of spatial cognition,establishes the context-awareness model to perceive and process the information in the scene,and puts forward the interaction design principle from the three aspects of the characteristics of virtual reality,assembly and interaction.Based on this,a virtual assembly system is designed and developed to verify the feasibility of interaction gesture set and interaction design principle.The system functions are divided into four modules:system UI,gesture recognition,object control and assembly assistance.The main functions and data transmission of the system modules are described.The two hands relative angle algorithm and the double nested animation system are proposed to optimize the system interaction design and logical relationship.