Application Of Gesture Interaction And Immersive Virtual Reality Technology In Creative System

With the development of information technology,computer technology and virtual reality technology,more and more man-machine interaction methods emerge.Virtual gesture interaction technology is one of the important innovation directions,widely used in aerospace,industrial applications and other fields,among which artistic creation is a new field of application exploration.And how to use integrate virtual interaction technology and computer computing for the development of virtual creation system platform has achieved certain results in many fields of application at present,but there is a lack of effective and instructive theory of design process method.Sand painting is a recently popular artistic creation,the traditional sand painting art space,light,material,tools,and other factors,lead to low recognition degree,creative implementation process such complicated problems,and don't have good communication and storage capability of defects,gesture interaction and immersion of virtual reality technology for the traditional sand painting art provides a new way of experience and creation.Based on virtual sand painting as the carrier,based on Leap Motion system of gesture interaction and virtual reality technology to integrate the Unity,from system as the research object of operators,the system operator centered principle to carry on the design,put forward the gesture interaction design framework and design method of the authoring system structures,design a virtual sand painting creation system,through the test of gesture recognition and validity of the test,test showed that can meet the requirements of real-time and effectiveness of virtual sand painting,and meet the spread of the artistic creation and storage capabilities,This case provides ideas and possibilities for other creative systems that integrate gesture interaction with virtual reality technology.The main research work of this paper includes :1)Analyzing the characteristics of gesture interaction system,analyzing the characteristics of system equipment,interaction characteristics and information characteristics.2)Proposed virtual gesture design principles and system design framework.3)Analyze the method and algorithm based on Leap motiom gesture recognition.4)Carry out case design for gesture interaction,and study the implementation process and method.5)Take virtual sand painting as an example to build scene model,conduct gesture and control design,conduct research on sand painting detail processing design,complete system design and conduct verification.The research objective of this paper is to combine immersive virtual reality technology and gesture interaction technology,and propose the process and method of gesture interactive creation system,so as to integrate artistic creation methods and virtual reality technology,optimize the process of artistic creation and realize the diversification of creative methods.The innovation achievements of this paper are as follows :1)The feasibility and effective design process of virtual creation system platform development is studied.2)Define the gesture meaning of virtual sand painting creation technology.3)Developed the virtual sand painting virtual simulation system platform in Unity software,designed the functional components and wrote and encapsulated the script code.4)Completed the algorithm optimization design of sand painting effect details processing,and realized the corresponding program of "accumulation" and "collapse" functions.5)Designed a color setting module for the virtual sand painting creation system to increase the diversity of sand painting creation,increase the sense of user experience,and make the sand painting creation process more realistic and fun.