Research On Bimanual Interactive Perception Technology Of Dynamic Stress Field

Stress analysis,as an essential tool for various structural analysis and object design,can assist engineers in designing workpieces with specified loads,so it is necessary to quickly and efficiently perform interactive sensing of dynamic stress fields.The conventional interaction technology of dynamic stress field is based on graphical user interface and data visualization technology to visually display stress distribution,which is inefficient and has poor user experience.Virtual/augmented reality and haptics applying to the interaction of dynamic stress field can improve the efficiency of stress perception and analysis,enhance the sense of interaction and immersion,and have broad application prospects and important social value.In order to update the dynamic stress field of a 3D deformable model in real time,we carried out in-depth research on individualized hand modeling and dynamic tracking,focusing on the working principle and algorithm of the technology.Firstly,the rest hand model with skeleton information is used as the template.With the skeleton data of the user’s hand from LeapMotion sensors as input,an automatic individualized modeling algorithm based on the bone size is proposed.An improved algorithm based on linear skinning of incomplete bone motion data is provided,which quickly calculates the transformed matrix between skeletons of different hand postures and dynamically update the posture of virtual hands.The experimental results show that the algorithm is computationally efficient,which provides sufficient time for other modules in the system.At the same time,it ensures the error is small,and it can be used in the interaction with 3D models.Aiming at the wearable haptics for dynamic stress field perception,a VR system is developed,and an immersive two-handed interaction mode is designed,including haptics module,3D model dynamics simulation module and graphic rendering module.Firstly,the introduction and function module description of the finger-type haptic module is introduced.The perceptual characteristics of humans on this device are studied.The experimental results show that people’s fingertips have different tactile sensations under different standard stimuli.Then the basic information of the three-dimensional deformable model is explained,and the finite element method is used to simulate the dynamics of the 3D model.Visualization interfaces and related algorithms are implemented using OpenGL and C++.Finally,relevant experimental research is carried out to verify the feasibility,reliability and effectiveness of the system.Finally,a low-cost finger motion tracking interaction algorithm is designed.Research on tracking of individual image markers is studied with the ARToolKit engine.This paper introduces the basic principle and implementation process of hand motion tracking algorithm based on multiple image markers,and designs a controller.This is a simple and effective solution to expand the tracking space of single image markers and obtain complete 6D fingertip motion.The controller is inexpensive,stable and easy to deploy.The experimental results show that the low-cost controller has the characteristics of real-time performance and high stability in augmented reality applications.