Design And Research Of Augmented Reality Surgical Navigation Systems

Medical imaging has been widely used to guide the therapeutic procedure,such as sentinel lymph node biopsy and plastic reconstruction surgery in patients with breast cancer.However,most medical imaging tools display the surgical scene on a standalone display,which may distract the surgeon from the operation.Therefore,there is a need to combine augmented reality with medical images.In this paper,we propose two augmented reality surgical navigation systems.We systematically study their performance and analyze their key parameters.The major research content of this paper are listed below.We design a Google Glass imaging navigation system for dual-mode optical and ultrasound imaging of suspicious lesions.The system consists of a CCD camera,an ultrasound probe,a LED excitation light source,a host laptop and a Google Glass.It is tested in tissue-simulating phantoms,an ex vivo human breast tissue model and a vivo human breast cancer patient.These experiments demonstrate that the surgical navigation system provides useful guidance for localization and resection of sentinel lymph nodes.We design a HoloLens augmented reality navigation system for three dimensional imaging outcome simulation.The system consists of a Kinect,a laptop,and a HoloLens.The Kinect is used to construct three dimensional models,which will be analyzed by the laptop and displayed in HoloLens.So by wearing the HoloLens,the surgeon could be guided by three dimensional images.The system is tested in a tissue simulating plasticine model,which illustrates that our system could have guidance in breast plastic surgery.We have tested the augmented reality surgical navigation systems in tissue-simulating phantoms and breast cancer patients,and the results support the contention that both of the navigation systems could be potentially useful by the surgeon for breast cancer treatment.