Research On Dynamic Tactile Fusion Feedback Method Based On Virtual Interaction

With the development of computer and virtual reality technology,the ways of human-computer interaction are also undergoing significant changes,and traditional audiovisual interaction can no longer meet people’s growing experiential needs.Tactile interaction expands the possibilities of human-computer interaction,producing a more realistic audio-visual experience and increasing the immersion of the interaction process.Tactile feedback devices can provide feedback on tactile information,allowing operators to remotely operate devices and interact with virtual objects.They have been widely used in industries,medical education,and other fields.At present,most researches on haptic feedback technology analyze kinesthetic feedback and skin feedback independently.This single mode of haptic feedback cannot reflect the multi-modal information(strength,stiffness,shape,etc.)contained in the touch itself.Regarding the multimodal information fusion rendering problem in tactile feedback,the specific research content of the paper is as follows:(1)Research on tactile perception mechanism and mechanical properties of fingertip skin.The relationship between fingertip deformation and contact force under different extrusion conditions was analyzed through numerical simulation and experiment.Based on the two-point discrimination threshold of fingertip skin and the characteristics of tactile perception mechanism,the distribution of extrusion stimulation points of fingertip skin deformation morphological characteristics during multi-point extrusion was determined,providing a design idea for the design of tactile feedback devices.(2)Design of a motion tactile fusion feedback system scheme.To address the issue of single tactile rendering modes in both kinesthetic feedback devices and skin feedback devices,a fingertip skin feedback device and a kinesthetic feedback device are designed.The theoretical error of the fingertip skin feedback device and the stability of the kinesthetic feedback device are analyzed,and a virtual interaction based dynamic tactile fusion feedback method is proposed.(3)Design of software for motion tactile fusion feedback system.Exploring the feature information of virtual objects during the interaction process expressed through a dynamic tactile fusion feedback mechanism,using a virtual engine to establish a virtual scene,writing script programs to achieve data collection during the virtual interaction process,and transmitting data through a computer serial port to establish communication between the virtual end and the device.(4)Experimental Study on the Method of Motion Touch Fusion Feedback.Focusing on the multimodal information fusion rendering problem in tactile feedback,virtual object shape perception experiments and virtual object elasticity judgment experiments were designed.The effectiveness of the dynamic tactile fusion feedback method was verified through the fusion rendering of motion feedback device and skin feedback device,enhancing the experience of tactile perception.To address the issue of multimodal information fusion rendering in tactile feedback,the tactile perception characteristics of fingertip skin and soft tissues are analyzed.Based on the differences in stimulation methods between tactile feedback and skin feedback,motion feedback devices and skin feedback devices are designed separately.By combining virtual reality technology,the mapping relationship between the master,slave,and virtual end is established to verify the effectiveness of the virtual interaction based motion touch fusion feedback method,Provide new possibilities for solving multimodal tactile feedback problems.