| For a long time,the state has attached great importance to the development of education,and the new curriculum reform has paid more and more attention to the cultivation of students' independent innovation ability and practical ability.In the experimental teaching of middle schools in China,the students' hands-on experiments are often affected by the uneven distribution of regional education resources,the difficulty of carrying out some dangerous experiments,experiments with no obvious observation effect and experiments with expensive materials,and the difference between teachers' teaching ideas.Therefore,in the actual experiment teaching,we often use the combination of teaching and video teaching round teaching or virtual simulation experiment teaching.This way,first of all,can not guarantee the students to have a deep understanding of the key points of the experiment process,the mechanism and phenomenon of the experiment;second,lack of experience and immersion,it is difficult for students to experience the fun of the experiment through exploration.At the same time,due to the lack of practical sense,it is not conducive to the cultivation of students' practical ability.In 2018,the national key R & D plan project-"virtual reality integration of multimodal natural interaction open experimental teaching environment" was approved successfully.The main research issues of the project are the integration and coexistence of multiple interaction models for the experimental teaching of the main courses in middle school,the accurate understanding of multimodal interaction intention and other scientific issues.It aims to promote the development of intelligent experimental teaching in middle school,and provide real-time simulation and multi-channel perception(viewing,listening,touching and smelling)of virtual reality integration in complex experimental teaching environment Synchronous presentation and other teaching experimental results.In addition,it is expected to realize the co construction and sharing of distance education of high-quality teaching resources in China.At the same time,it is expected to better explain and show the scientific principles through the more immersive experiment of virtual and real integration,break through the original experimental teaching mode and develop new experiments,so as to solve the problems of poor autonomy,weak exploration,lack of immersion and experience in the existing middle school practical courses A series of problems with low accuracy and high experimental cost.Therefore,based on the project and the application background of experimental teaching in middle school,this paper aims to solve the problems of pain points and difficulties in the current experimental teaching in middle school and improve the experience of experimental teaching.The main innovations of this paper are as follows:(1)An intelligent interactive device for virtual reality fusion experiment is designed and manufactured.In view of the lack of real sense of operation and good sense of immersion in virtual simulation experiment,this paper designs and makes an intelligent interactive device for virtual reality fusion experiment based on the actual experimental equipment.One is a navigation microscope for biological experiment in middle school,the other is a set of beaker kits for chemical experiment in middle school.This equipment not only has the operation function of the traditional experimental equipment,but also breaks through the limitations of the weak interaction function of the existing virtual experimental equipment,which is inconsistent with the real experimental operation process of students.In the design,we use the micro sensor to collect the user's operation data,integrate the hardware device with the virtual scene,and make the user get timely and effective feedback through the interaction algorithm,so that the user can feel the same operation experience as using the actual experimental equipment.The experiment shows that this design not only deepens the user's understanding of the operation steps and key points of the experiment,but also improves the user experience and teaching effect.(2)A static gesture recognition algorithm based on feature fusion of depth image and RGB image is proposed.In the training of small sample gesture recognition model based on convolutional neural network,the internal texture of deep gesture image is not clear,but it is easy to shield the influence of surrounding environment.For RGB gesture image,the internal texture is clear,but it is easy to be affected by complex background.Based on the framework of caffenet network,this paper constructs a two-channel convolutional neural network which combines the features of two gesture images.Different from the static gesture recognition framework of single channel convolution network,the dual channel convolution neural network can extract different image features of the same gesture through different channels.Finally,the fusion layer features are used for classifier training.Experimental analysis shows that the static gesture recognition model has higher recognition accuracy than single channel gesture recognition model and some typical recognition models.(3)A user intention understanding algorithm based on multi-channel information fusion strategy is proposed.In the first mock exam,it is difficult to fully express user intention and multimodal information is not easy to manage and utilize.In this paper,a multi-channel information fusion strategy for user intention understanding and navigation interaction algorithm based on user intention understanding is proposed.First of all,we investigate and analyze the lack of realism and experience caused by single-mode interaction in the middle school experiment at this stage.Then we combine the methods of obtaining different modal information,use the physical interaction kit to collect multimodal and heterogeneous data,and then design the multi-channel information fusion strategy.Through the integration and management of different channel information,we can complete the user intention Understanding,according to the user's intention to complete intelligent navigation interaction,and finally form a set of intelligent middle school experimental tools that are feasible from algorithm to hardware device and used for teaching research..(4)A new interaction model for virtual reality fusion experiment is constructed.Aiming at the problems of lack of experience,poor sense of experience and single and tedious operation process caused by the mixed teaching experiment and virtual experiment teaching in the current middle school teaching experiment,at the same time,in order to make the virtual reality fusion technology better integrate into the middle school experiment teaching and stimulate the students' independent exploration and learning spirit.This paper puts forward a new "breakthrough" teaching mode for virtual reality experiment,which breaks through the traditional experimental teaching mode and virtual experimental teaching mode,and advocates the experimental learning mode of independent exploration.First of all,this paper gives the overall design principles of the teaching mode,and then,from the data structure and the process of the "breakthrough" teaching design method.Finally,taking the sodium water reaction chemistry experiment as the teaching case,based on the intelligent experimental equipment and the multi-channel information integration algorithm,this paper developed the breakthrough experimental teaching system.The experimental results show that the model can stimulate students' interest in the experiment,help students to carry out inquiry learning,and deepen students' understanding of the experimental operation and key points. |
PDF Full Text Request