Research On Multi-point Vibration Sensing Interaction Based On Touch Screen

The current human-computer interaction methods are mainly focused on vision and hearing,which can provide limited tactile experience.Combining tactility with a touch screen allows the operator to touch and perceive virtual objects and realize active exploration of the virtual environment.In order to further improve the quality of human-computer interaction,based on the immersive characteristics of virtual reality technology,this paper conducts research on the multi-point vibration-based tactile perception interaction and methods based on the touch screen.This article mainly studies the application of multi-point vibration perception and interaction on the touch screen,which mainly includes three parts:(1)A device with tactile feedback is designed,and the main control chip of the device is STM32f103.The carrier of this device is a capacitive touch screen,and the vibration mode of the vibration motor is controlled by the STM32 chip to obtain different tactile sensations.(2)The influence of different vibration modes on tactile perception is studied.In the experiment,first determine the appropriate driving voltage,frequency and waveform related parameters when the user uses the device,and then change each parameter to collect the user's subjective tactile evaluation.It is verified that in a specific vibration mode,a realistic and reliable fingertip tactile reproduction can be achieved on the touch screen.(3)Introduced the working principle of the Leap Motion somatosensory controller,established the relationship model between the actual texture information of the object and the vibration and tactile sensation,and studied the influence of the experimental object's fingertip movement rate on the tactile perception.The research focus and innovation of this paper are:(1)Establishing a multi-point vibration-based tactile interaction model;(2)Studying the influence of vibration parameters and fingertip movement rate on tactile perception.