Design And Implementation Of Multi-sensing Channel Interactive Gloves

Experimental teaching is an important teaching content stipulated in the curriculum standards of the national curriculum plan.The use of virtual reality technology can solve the problems of difficulty in observation,danger,and harm to the environment in physical,chemical and biological experiments.The realism of virtual experiments is mainly determined by multiple perception channels such as audio-visual touch-smell and so on.As the main channel of human skin perception,touch can improve the immersion of virtual experiments and the effect of virtual experiment teaching.In the current middle school experiment,a hands-on experiment is required.The part of tactile perception is the human hand,and the tactile sensations are mainly force touch and warm touch.However,most virtual experiments are still based on the presentation of visual perception channels.Currently,there is a lack of interactive devices on the market that are suitable for virtual experiments that integrate force-tactile and thermal-tactile channels.In view of the above problems,the thesis studies the interaction technology and application of integrating multi-sensing channels,and designs a multi-sensing channel interaction scheme suitable for virtual experiments in middle school science,chemistry,biology and other disciplines,including the interaction design of multi-sensing channel interaction gloves,Design and implementation of force-tactile and thermal-tactile perception channels.Finally,a typical chemical virtual experiment is constructed to verify the effectiveness of the fusion multi-sensing channel interaction scheme proposed in the thesis.The main research work of this thesis is as follows:（1）This thesis analyzes the requirements of virtual experiment in middle school for the realism and fidelity of experimental operation,and proposes an interaction scheme that is suitable for virtual experiments of middle school physics,chemistry,students and other disciplines and integrates multi-sensing channels.The overall program framework is discussed as necessary.（2）Design a hand data acquisition method based on bending sensors,including the sensor circuit design that supports this acquisition method,determine the layout through the sensor placement test,develop sensor data transmission and analysis algorithms,filter and fit sensor characteristic curves,analyze Human hand skeleton joints,skeleton binding of virtual hand model,data mapping of virtual hand,and visual interaction of virtual experiments.（3）A force-tactile sensing channel presentation method based on a vibration motor is designed.According to the film pressure test sensor,the pressure of actually taking the experimental object is measured,and the simulated force-tactile feedback signal is generated to perform presentation through the dynamic motor.A method for presenting a thermal tactile sensing channel based on a semiconductor cooling chip is improved,and a simulated thermal tactile feedback signal is generated to perform presentation through the semiconductor cooling chip.（4）Build a typical middle school virtual experiment case to verify the ease of use of the technology and the fidelity of virtual experiment interaction.By inviting volunteers to wear interactive gloves to operate the experiment,record and analyze the experimental data and the evaluation of the experience effect.Validation and evaluation of the practicality of the design scheme of a multi-sensing channel interaction glove.