Research On Vascular Interventional Surgeon Training System Based On Augmented Reality

Cardiovascular and cerebrovascular diseases are a common disease that seriously threatens human life,with high mortality,high disability rate and high proportion of death,and the most effective means for this disease is vascular interventional surgery,but interventional treatment has high technical requirements for physicians and must undergo professional technical training.Although the current prevailing virtual reality training system solves the above problems,it does not give the trainee doctors a sense of immersion,which has a certain impact on the training efficiency and effect.Based on this problem,this paper builds a training system based on augmented reality technology to make the operating environment closer to the real world,and introduces gesture interaction technology to achieve more natural interaction,so as to further improve the immersion of the training system.The construction of the system is mainly divided into two parts: three-dimensional registration and gesture interaction.Firstly,starting from the three-dimensional registration technology based on markers,the problems of camera coordinate system,world coordinate system and screen coordinate unification are discussed,which provides a basis for displaying virtual objects and human-virtual object interaction.Secondly,this paper uses a vision-based gesture detection method to establish a relatively natural interaction system,users can directly operate virtual instruments,can also complete the contraction and rotation of the model through gesture instructions,for a single camera can not solve the problem of gesture occlusion,two cameras are used,and the coordinate system is unified by direct linear transformation,gesture modeling is completed,and the distance between the hand and the camera is estimated by the pinhole camera model,and the three-dimensional coordinates of the spatial position of the hand are established,with an average error of 1.5mm.Finally,this paper introduces wireless communication to connect various hardware and software modules,completes the construction of the whole system,designs experiments to study the performance of the system,and connects with the main end operator in the laboratory,and conducts a comparative experiment on model interaction with the existing virtual reality training system,shortens the training time of the new system by about 10%,and significantly reduces the redundant actions of the trainees,which proves that it has improved the sense of presence and ease of operation.