A Middle School Lab Software Framework For Virtual-reality Fusion

In recent years,with the continuous development of virtual reality technology,the virtual-reality fusion lab software for middle schools came into being.This new virtual experiment mode,It not only combines the advantages of the traditional three-dimensional virtual experiment that partially or completely replaces the experimental environment,experimental equipment and experimental operation steps of the real experiment,At the same time,it makes full use of the virtual-reality fusion technology,breaks through the limitation of time and region,transcends the restriction of real natural physical conditions,realizes microscopic,space,dangerous and invisible experiments,creates an immersive experimental scene and operation feel for students,and brings revolutionary influence to the innovation of experimental teaching.However,the main problems encountered by this kind of software at present are:the traditional three-dimensional virtual experiment software only supports the input and output of one modal terminal,and the multi-modal interaction cannot be well realized for crossplatform multi-terminal hardware equipment,which limits the operation mode of user experimental equipment and affects the presentation of the real hand feeling of experimental operation;The experimental process is fixed in advance,Moreover,there is only one kind of experimental step flow,which is difficult to model the experimental step flow described by words by computer,the software has weak control over the experimental flow,the experimental step cannot well support the user’s independent inquiry experiment,cannot accurately judge and score,and accurately present correct and wrong experimental results;The experimental effect is separated from the experimental equipment,which cannot reflect the characteristics of natural physical attributes in the real environment.At the same time,in the multi-scene rendering environment where the actual situation is integrated,the diversity rendering of experimental effect is difficult to meet the needs of practical application.For this reason,this paper studies the software framework of middle school virtual experiment supporting the virtual-reality fusion,and the results are summarized as follows:(1)A pattern-based multi-modal interactive software architecture is constructedAiming at the problem of how to realize hardware adaptation in multi-modal interaction,a multi-modal software framework based on mode is designed.By generalizing the design of interaction primitives,the differences of interaction terminal hardware are further shielded,and the unification of multi-modal interaction terminals on operation instructions is realized.Finally,through the observer mode,the data communication between the interactive module and other modules is realized.(2)An experiment flow control engine based on Petri Net is designedAiming at the problems that the experiment process is difficult to model and the experiment steps cannot be accurately judged,Petri Net modeling and timestamp mechanism are used for reference,and the two-level subdivision strategy based on the experiment steps is used to realize the flexible organization and dynamic loading of the experiment steps,thus realizing the fine scoring of the user’s experiment operation steps.(3)An experiment simulation presentation mode based on equipment-driven is constructedAiming at the problem of multiplicity generation of experiment results,an experiment simulation presentation mode based on the strategy of "equipment-parameters-effects is proposed.On the basis of paying attention to the natural physical attributes of experiment equipment,experiment equipment parameters and experiment step parameters,the mode runs through the experiment process through the programmable rendering pipeline,and realizes the dynamic generation and control of simulation presentation effects according to the experiment steps.(4)A framework based on message mechanism is integrated and appliedBased on the message mechanism,the "interaction-process-presentation" framework is implemented,and based on Unity’s own modules,the software framework integration based on the integration mechanism is realized.Finally,two typical middle school experiments are selected to verify the effectiveness of the framework through development and application.The software framework proposed in this paper not only effectively supports the development of virtual experiment software in middle schools,but also provides a new solution for the design and development of similar virtual simulation software.