Purpose: This paper aims to develop a navigation system based on mixed reality, which can displaymultimodal medical images in an immersive environment and help surgeons locate the target areaand surrounding important ...Purpose: This paper aims to develop a navigation system based on mixed reality, which can displaymultimodal medical images in an immersive environment and help surgeons locate the target areaand surrounding important tissues precisely.Methods: To be displayed properly in mixed reality, medical images are processed in this system.High-quality cerebral vessels and nerve fibers with proper colors are reconstructed and exported tomixed reality environment. Multimodal images and models are registered and fused, extracting theirkey information. The multiple processed images are fused with the real patient in the same coordinatesystem to guide the surgery.Results: The multimodal image system is designed and validated properly. In phantom experiments,the average error of preoperative registration is 1.003 mm and the standard deviation is 0.096 mm.The average proportion of well-registered areas is 94.9%. In patient experiments, the surgeons whoparticipated in the experiments generally indicated that the system had excellent performance andgreat application prospect for neurosurgery.Conclusion: This article proposes a navigation system of multimodal images for neurosurgery basedon mixed reality. Compared with other navigation methods, this system can help surgeons locate thetarget area and surrounding important tissues more precisely and rapidly.展开更多
基金This work was supported by the National Key R and D Program of China(No.2022YFB4702600,2022YFB4702601)the Innovation Foundation for Postgraduate of Tianjin,China(Grant No.2022BKY063,No.2022SKY046).
文摘Purpose: This paper aims to develop a navigation system based on mixed reality, which can displaymultimodal medical images in an immersive environment and help surgeons locate the target areaand surrounding important tissues precisely.Methods: To be displayed properly in mixed reality, medical images are processed in this system.High-quality cerebral vessels and nerve fibers with proper colors are reconstructed and exported tomixed reality environment. Multimodal images and models are registered and fused, extracting theirkey information. The multiple processed images are fused with the real patient in the same coordinatesystem to guide the surgery.Results: The multimodal image system is designed and validated properly. In phantom experiments,the average error of preoperative registration is 1.003 mm and the standard deviation is 0.096 mm.The average proportion of well-registered areas is 94.9%. In patient experiments, the surgeons whoparticipated in the experiments generally indicated that the system had excellent performance andgreat application prospect for neurosurgery.Conclusion: This article proposes a navigation system of multimodal images for neurosurgery basedon mixed reality. Compared with other navigation methods, this system can help surgeons locate thetarget area and surrounding important tissues more precisely and rapidly.
