Font Size: a A A

Research On Augmented Reality Display Technology Of Neurosurgery Craniotomy

Posted on:2022-04-13Degree:MasterType:Thesis
Country:ChinaCandidate:H ZhangFull Text:PDF
GTID:2494306494466534Subject:Mechanical engineering
Abstract/Summary:PDF Full Text Request
With the integration and development of technology and medical treatment,neurosurgery craniotomy has made great progress in clinical practice,but traditional craniotomy still has many problems.When performing a craniotomy,medical staff mainly use the two-dimensional medical image of the patient’s skull to estimate the location of the patient’s intracranial lesions.It is not possible to accurately plan the area of the craniotomy during surgical planning,which causes the problem of excessively large skull openings and easy injury to important tissues such as the venous sinus.In addition,the surgical process relies too much on the clinical experience and operational skills of medical staff.Therefore,in order to help medical staff more intuitively determine the patient’s lesion information,improve the accuracy of the surgical planning path and the safety of craniotomy,and meet the principle of minimizing surgical damage.This paper focuses on the lesions display technology of craniotomy craniotomy.The three-dimensional reconstruction technology of the patient’s lesions environment,the lesions augmented reality display technology,and the lesions curve projection image distortion correction technology have been deeply studied.The specific work content is as follows:Firstly,by acquiring two-dimensional medical images of the patient,the threedimensional models of the patient’s lesions,blood vessels,skull and other tissues have been reconstructed based on methods of threshold segmentation and region growth,and the noise reduction processing on the reconstructed model is performed.Secondly,through the use of augmented reality technology,an augmented reality system for lesions was developed and applied to the Android platform.By comparing the virtual-real matching of the feature contour with the virtual-real matching method of the point cloud,the superiority of the virtual-real matching of the feature contour is determined.By compiling a human-computer interaction interface,medical staff can better observe the tiny information around the lesion by adjusting the virtual lesion model in the mobile terminal,so that the doctor can plan the craniotomy route while avoiding the dangerous area.The augmented reality system for lesions was verified through Huawei Pad experiments.Finally,by projecting the image containing the lesion information to the correct position on the patient’s body surface,the content of the patient’s lesion can be displayed more intuitively.In view of the problem that the projection image will distort on the irregular surface of the body,and aiming at the problem of calculating the pre-projected image when projecting on a curved surface,an image distortion correction method based on feature point cloud mapping is proposed after in-depth study of traditional distortion correction methods.By establishing the mapping relationship between the projector image and the camera image,the pre-correction image is calculated.The precorrected image is reprojected to the original projection position to obtain an image that satisfies the visual effect.The simulation experiment was carried out through 3DS MAX software,and the feasibility of the method was verified.
Keywords/Search Tags:Three-dimensional Reconstruction, Augmented Reality, Curved Projection, Image Distortion Correction
PDF Full Text Request
Related items