Research On The Key Technology And Application Of Smart Glove For Experimental Teaching Of Fusion Of Virtual And Reality

In the current middle school experimental teaching process,some experimental supplies are highly dangerous.If students operate improperly,it will threaten the safety of students.Secondly,the experimental process of some experiments is more dangerous or some experimental materials are more expensive.In actual classroom teaching,video display is often used to carry out experimental teaching.Although this method can enable students to understand the experimental phenomenon of the experiment,it is difficult to ensure that students have a deep understanding of the experimental mechanism and important experimental operations.In actual classroom teaching,there is often a problem that teachers cannot guide each student one-to-one.Although the emergence of the virtual experiment platform provides solutions to the above problems,whether it is using a mouse,keyboard or virtual reality,augmented reality,etc.,there are generally problems of poor experimental operation and weak experimental immersion,which is not conducive to the improvement of students’ hands-on ability.At the same time,some experimental platforms require users to memorize a large number of operating rules during the experiment,which increases the user’s memory load.Therefore,under the support of the National Key R&D Project "Multi-modal Natural Interactive Virtual and Real Fusion Open Experimental Teaching Environment",we design a smart glove hardware structure for middle school experimental teaching,allowing users to conduct experiments through the fusion of virtual and real,enhancing the user’s experimental immersion,improving students’ hands-on operation ability,and then making up for the many operating rules of some virtual experimental platforms,and the user’s memory load is heavier,and the inquisitiveness is poor.The main contents and innovations of this article mainly include the following aspects:(1)A smart glove suite interactive device for middle school experimental scenes is designed and implemented,the device can not only collect user behavior data generated during the experiment,but also can perform multi-modal perception and recognition of user behavior,experimental scene and other information based on these data.(2)A navigational interaction mode for smart glove is proposed.In view of the heavy cognitive load of some virtual experimental platforms,based on the contextual interaction scenarios of user operations,the navigational interaction mode achieves the acquisition of user intentions by fusing the acquired multi-modal information,and can according to the user’s intention to guide the user’s behavior.(3)A chemical experiment system based on the smart glove is designed and implemented.We establish an intelligent chemistry experiment system on the Unity platform.Users can operate real experimental equipment in this system by wearing smart glove,which makes up for the lack of experimental operation in virtual experiment teaching.Using the intelligent navigational interactive method to monitor and guide user behaviors improves the interactive efficiency of the system,reduces the cognitive load of users,and enables users to focus more on chemical experiment exploration.