Research On VR Experimental Learning Experience Based On Gesture Interaction Technology Of Leap Motion

With the rapid development of computer hardware and software technology,Human-Computer interaction is changing,and people's needs for interaction are more diversified.Using gestures to interact with the computer is more consistent with users' usage habits,which does not require complicated learning and can significantly improve users' interaction experience.In the virtual experiment,gesture interaction can enable learners to directly control 3D virtual objects.Moreover,the experimental operation is based on the experience of real experiments,and the non-natural control habit of WIMP interaction is released to make learners pay more attention to the learning task itself and improve the learning experience.Firstly,through the analysis of the existing user experience models and theories,this study proposed that the design of perception experience,interactive experience and affection experience should be emphasized in the development of virtual experiments.Combining the characteristics of virtual experiment and gesture interaction,a learning experience model based on gesture interaction technology in virtual experiment is constructed.Based on the model analysis,four basic principles of designing and developing virtual experiments based on gesture interaction technology are summarized.Then,the framework of gesture interaction design in virtual experiment is constructed.By analyzing the characteristics of gestures,four main features of gesture design are summarized and extracted,which are described in mathematical form,and the semantic table of gesture interaction in virtual experiment is constructed.Then,the Leap Motion controller was used as the gesture input device,and combined with the Unity 3D development engine,the virtual experiment of computer installation based on gesture interaction technology was designed and realized.Finally,using the virtual experiment as a research tool,this paper discusses the influence of virtual experiments based on gesture interaction technology on learners' learning experience from three aspects: Immersion,Learning Motivation and Attitude.The main conclusions are as follows:(1)In the sense of immersion,there is a significant difference between learners' sense of Presence,Involvement and Experienced Realism.Virtual experiments based on gesture interaction technology can stimulate learners' learning motivation,especially stimulate learners' interest in learning,and focus learners' attention on experimental tasks.Learners using gesture interaction technology have more confidence to complete the experimental task and achieve the experimental goal.(3)The usability of the virtual experiment based on gesture interaction technology is directly related to learners' willingness to use it,while learners' affection experience will also influence learners' behavior of using the virtual experiment.(4)For the three aspects of Immersion,Motivation and Attitude,there is a significant correlation between Learning Motivation and Immersion and Attitude.In other words,learners' learning motivation has an important influence on their learning experience in virtual experiments.