Creation And Research Of Performance Game Based On The Interaction Of Somatosensory And Expression

Since the release of the Will game console in 2006,the form of somatosensory interaction has been continuously developed in various forms from the moment it came out,stunning everyone to blooming,and now somatosensory interaction has become an important interactive experience,and is widely used in education,design,architecture,Medical and other industries.With the continuous development of somatosensory technology,it also promotes the progress of motion capture technology and facial expression capture technology.It has made great progress in the application of these technologies in the fields of animation,film and game and games.However,the application of these techniques in combination with traditional Chinese opera culture is relatively rare,especially in some relatively small local operas,resulting in a lack of understanding of Chinese traditional opera culture among many young people,and even some traditional local operas are outdated due to their outdated forms.and cannot be passed on.As an excellent local culture in Gansu,Tongwei Xiaoqu once faced such a crisis.In 2011,through the continuous efforts of the local government and people,Tongwei Xiaoqu was selected as a national intangible cultural heritage.In order to allow more people to understand Tongwei Xiaoqu,it is necessary to combine modern technology with traditional cultural and artistic forms for innovation.This article is based on this as the starting point,based on motion capture and facial expression capture technology,and based on the story of "Bo Ya Fuqin" in the traditional Gansu local opera Tongwei Xiaoqu,using the Unity real-time rendering development platform and the Kinect somatosensory camera to create Real-time rendering of animation and somatosensory interactive opera games.Based on the lyric content of the Tongwei Xiaoqu "Bo Ya Fuqin",the story script was written,and the scene script was drawn based on the story script,and the character game image was designed.Use Character Creator3 to make character models,use Marvelous Designer to make character clothing models,combine clothing and character models,and import them into Unity.Based on the C/S structure,the motion capture technology and the facial expression capture technology are integrated and applied,combined with the Unity real-time rendering development platform and the animation production tool Timeline that comes with the platform to produce real-time rendering animations.Finally,based on the completed real-time rendering animation,combined with the Kinect somatosensory camera,a performance interactive game was produced.Give Tongwei Xiaoqu new vitality in a new form of expression,and achieve the combination and development of technology and art.Through this research,I hope to better publicize traditional opera culture in the form of games,and provide a new direction for the innovation and development of Tongwei Xiaoqu.This creation is innovative in the production process.The combination of motion capture technology and facial expression capture technology combined with the Unity real-time rendering development platform greatly improves the production efficiency of 3D animation.At the same time,the character model produced by Character Creator3 itself has model bones and character expression Blend.Shape,and C software also provides a format interface specifically for the Unity platform,which improves the production efficiency of character models.This article provides a complete production scheme for the rapid production process of real-time rendering animation.