Investigation Of Minimally Invasive Spine Surgery Navigation System Based On Spatial Augmented Reality

This research focuses on a minimally invasive spine surgery navigation system based on spatial augmented reality,and a light calibration algorithm with a sine grey code structure based on time series is proposed.Additionally,an adaptive lattice based on ternary markers is established.This overall system is developed to improve the intraoperative navigation effect of minimally invasive spine surgery in clinical settings and the accuracy and reliability of intraoperative surgical instrument placement.The main research steps and results are as follows.First,the light algorithm with a sine greycode structure based on time series is proposed for the calibration of the hardware system before minimally invasive spine surgery.The algorithm uses a sinusoidal grey code structure to establish the encoding pattern and uses a time phase unwrapping algorithm and the three-step phase shift method to phase unwrap the greycode pattern and obtain a continuous grey code projection pattern.This algorithm performs image capture and matching and establish the corresponding relationship between the camera image pixels and the pixel points of the target object projected.Compared with the traditional structured light algorithm,this algorithm can effectively capture the projection pattern and establish pixel correspondence relations;moreover,it is faster to execute.Second,for the identification and tracking of intraoperative surgical instruments in minimally invasive spine surgery,a ternary-based adaptive dot matrix marker is designed.Different combinations of dot arrays are used to realize the custom design of markers,the size and number of markers are changed to simultaneously identify multiple markers in clinical operations,and the adaptive PNP algorithm can achieve the real-time identification and tracking of dot-matrix markers.By binding the markers to surgical instruments,using the rotation calibration method to calibrate the surgical instruments,tracking the surgical instruments in real time and estimating instrument poses,the relative positions of the surgical instruments and the virtual surgical path can be visualized.Finally,for intraoperative image guidance for minimally invasive spine surgery,a minimally invasive spine surgery navigation system based on spatial augmented reality is established.The system uses Aruco fiducial markers to locate the patient’s spatial position,uses the improved ICP algorithm to register and fuse the three-dimensional medical images reconstructed by the surgical planning system with the patient’s spatial position information,and projects a three-dimensional virtual medical image of the patient’s back area for spinal procedures.The external visualization of surgical information,such as muscles and surgical paths,supports intraoperative image guidance based on multisource information.A phantom experiment carried out in the laboratory verifies that the navigation system can provide intuitive and efficient intraoperative navigation and meet the clinical needs of minimally invasive spinal surgery.In this paper,the research on a minimally invasive spine surgery navigation system based on spatial augmented reality is helpful to solve the problems of poor treatment effect of minimally invasive spine surgery and the inability to accurately place surgical instruments,so as to improve the clinical treatment effect.