Research On Multi-mode Haptic Display Based On Image

Haptic interaction technology is an important part of human-computer interaction in virtual reality.It realizes haptic feedback to human through stimulating the human haptic perception process of real objects in virtual environment.This greatly improves the interactivity and telepresence of the virtual environment.While the images as a three-dimensional real scene in the two-dimensional camera imaging plane projection,retain rich information of the object surface.Therefore,the study of haptic display of images has attracted wide attention of researchers.With the application of virtual reality technology in the fields of blindness,medical treatment,mobile terminals and special operations,image-based haptic display technology usher in new opportunities and challenges.This paper focuses on the haptic display based on images.This paper has carried on the research of extraction of multi-feature of images,haptic modeling and multi-mode haptic display based on image for the purpose of improving the quality of the extracted image features and authenticity of haptic perception.Firstly,the research status on the aspects of haptic device,haptic modeling and haptic display method and etc are analyzed.Based on the analysis of the research status,a texture extraction algorithm based on fractional calculus is proposed to meet the requirement of texture haptic rendering.The haptic model of color texture image based on human visual physiological and psychological characteristics are established.The haptic information of the texture is fed back to the human by the haptic device in order to achieve haptic display of image texture.Aiming at the limitation of texture expression based on vibration tactile,a simple piezoelectric ceramic tactile pen was used to make a large number of human haptic perception experiments.The vibration characteristics of the piezoelectric actuator,such as the amplitude,frequency and modulation wave of the driving voltage are studied and analyzed.Then texture vibrating tactile model is established to achieve the vibration tactile display of the image texture.Aiming at the problem that the haptic perception of the three-dimensional surface shape of the object and the material(texture)are easily confused in the virtual environment,a multi-mode haptic display method is proposed.It means that the features of the images are extracted and haptic rendering is performed respectively.And then the image is displayed by the different haptic expressions.In this paper,the three-dimensional geometric shape,detail texture and contour line are extracted by various image processing algorithms and the force rendered and vibration tactile rendered respectively.And based on the force feedback device,a vibrating tactile display integrated device based on the piezoelectric ceramic is designed to express the image texture and contour.Haptic experiments show that the multi-mode haptic display method can effectively improve the authenticity of haptic perception.In order to enhance the haptic interaction function of the mobile terminal,a multi-mode haptic display method for mobile terminal is proposed.According to the characteristics of the mobile terminal,three kinds of features of the image are extracted and haptic modeled by light quantization algorithm.In addition,the haptic pen based on the active force feedback and piezoelectric ceramic vibration tactile feedback is designed to achieve the multi-mode haptic display of image for mobile terminal.