Visual Editing For Virtual Experiment Fusion With Multi-sensing Channels

The virtual experiment platform is a human-computer interaction platform that based on multimedia,simulation and virtual reality(Virtual reality,VR)and other technologies.It creates a combination of software and hardware on the computer that can assist,partially replace or even replace the relevant software and hardware operating environment of each operation link of the traditional experiment.The traditional virtual experiment platform is mainly based on visual perception channels,which makes its performance single.At the same time,students can only operate strictly in accordance with the inherent steps of the platform,which cannot meet the requirements of exploratory teaching.On the other hand,teachers who have a strong demand for virtual experiments do not have specific development capabilities,nor do they have enough funds to ask professional companies to develop them.As a result,the current virtual experiment cases on the market cannot meet the teaching needs of teachers.In order to solve the above problems,a multi-channel fusion virtual experiment visualization and experience platform is proposed,and the core technologies and implementation methods involved are described in detail.This platform allows even teachers who do not have a programming foundation to develop multi-sensing channel fusion virtual experiments that meet their needs through simple text writing and visual configuration,It can better support students to conduct exploratory learning in a virtual environment.The main research work of the paper is as follows:(1)Establish a virtual experiment description model based on Petri nets,and define and parameterize each component of the virtual experiment.A Petri net is used to parametrically describe the sequence of experimental steps.Propose the steps of experimental steps,describe the complex logical relations in the sequence of experimental steps.The virtual experimental steps are no longer carried out step by step,and the development of exploratory experiments can be realized.(2)The realization of the visualized writing method of virtual experiment is proposed,based on the fusion of multi-sensing channels.Realize the editing of experimental scenes through resource import and parameter configuration.The Petri net is used to describe the sequence of experimental steps,and the conversion relationship between the routing graph and the Petri net is established.So that the editing of the sequence of experimental steps is realized through the visual editing of the routing graph.Completing the editing of the experimental scene and the sequence of experimental steps means that the editing of the virtual experiment is completed.Use XML text language to store,read and present the editing results of experimental scenes and sequence of experimental steps.Use ASP.NET and other technologies to establish a virtual experiment resource library based on the mixed mode of B/S and C/S to realize the sharing of virtual experiment resources.(3)The realization of virtual experiment’s multi-sensing channel presentation method and human-computer interaction method is proposed.Taking olfactory information and temperature sensing information as an experimental step.It is also applicable to the description of Petri nets and the editing of routing graphs,so as to establish the editing and presenting methods of olfactory channel and temperature sensing channel information.(4)Development and realization of a prototype system for virtual experiment visualization editing and experience fusion of multi-sensing channels.The hardware and software architecture of the prototype system is introduced in detail.And through three specific experimental cases to verify the effectiveness of visual editing,multi-sensing channel effect presentation and exploratory interactive experience.The results show that the editing and development is efficient,and the virtual experiment developed has a good sense of immersion and can meet the needs of exploratory experiments.