Research And Application Of Action Viewing And Learning System Based On Immersive Virtual Reality And Motion Capture

The action viewing and learning system based on immersive virtual reality and motion capture can simulate the surrounding real environment,and users can use the system to watch Kung Fu culture and assist learning Kung Fu action.For the traditional Chinese Kung Fu culture,it is more difficult to realize protection and inheritance.The existing pictures and audio-visual preservation modes have their drawbacks.The learning and training process in the process of inheritance is time-consuming and the students are prone to school-weariness.The three-dimensional digitization of Kung Fu culture is an innovative way of protection.Using the immersive display method can attract more people to watch and assist students to learn efficiently,and can realize the effective inheritance of traditional Kung Fu.In this paper,virtual reality technology and motion capture technology are introduced into the protection field of Kung Fu culture,and virtual systems that appreciate both appreciation and learning are developed to solve the problems of protection and inheritance.The viewing and learning system tracks and recognizes the user's limbs through motion capture technology,and uses virtual reality engine to realize action data driven character model to realize the visualization of the characters in the virtual environment and the quantitative evaluation of the results.In order to realize the immersion,realism and effectiveness of the system,the research work done in this paper includes:(1)The background conditions and significance of the development of the appreciation system are researched,and the existing technology is studied.The current research status is analyzed.The problems existing in the traditional Kung Fu inheritance and protection process are proposed.The hardware and software equipment that needs to be used has been studied.(2)Study the key technologies needed to create virtual scenes for learning,select technologies with higher precision,better stability and more convenience.The technologies that need to be studied include 3D model optimization technology,global optical technology,collision detection technology and Immersive technology.(3)Analyze and process the acquired data,compare the advantages and disadvantages of various processing methods,and propose the quaternion Kalman filtering method to process the metadata to realize the action data driven character model.The curve matching algorithm based on curve pre-segmentation is used to realize the identification,matching and similarity measurement of different curves,and the comparison and guidance with standard actions are realized.The system also provides modes of different difficulty for the students to choose.(4)Build a virtual learning system and develop corresponding scenes.Users can watch Kung Fu movements through an immersive visual interface.Scene culture is also an inseparable part of traditional culture,which allows users to be completely in the ancient cultural scene.Added fun,and realized the function of Kung Fu action and scene display.Using database technology,the existing data is entered into the database,the data acquired by the motion capture instrument is compared with the standard data,and the system gives quantitative evaluation,so that the students have a quantitative understanding of the level they have mastered,and realize the evaluation of action learning Features.This paper mainly combines immersive virtual reality technology and motion capture technology,and proposes effective ways and methods for all the goals to be achieved.Finally,we invite different people to experience the development of the system to conduct experimental tests to verify the methods of our research Feasibility,the feedback from the experiment reached the expected goal.