This paper presents a novel augmented reality(AR)-based neurosurgical training simulator which provides a very natural way for surgeons to learn neurosurgical skills.Surgical simulation with bimanual haptic interactio...This paper presents a novel augmented reality(AR)-based neurosurgical training simulator which provides a very natural way for surgeons to learn neurosurgical skills.Surgical simulation with bimanual haptic interaction is integrated in this work to provide a simulated environment for users to achieve holographic guidance for pre-operative training.To achieve the AR guidance,the simulator should precisely overlay the 3D anatomical information of the hidden target organs in the patients in real surgery.In this regard,the patient-specific anatomy structures are reconstructed from segmented brain magnetic resonance imaging.We propose a registration method for precise mapping of the virtual and real information.In addition,the simulator provides bimanual haptic interaction in a holographic environment to mimic real brain tumor resection.In this study,we conduct AR-based guidance validation and a user study on the developed simulator,which demonstrate the high accuracy of our AR-based neurosurgery simulator,as well as the AR guidance mode’s potential to improve neurosurgery by simplifying the operation,reducing the difficulty of the operation,shortening the operation time,and increasing the precision of the operation.展开更多
基金This study was funded by National Natural Science Foundation of China(No.61802385)Natural Science Foundation of Guangdong(No.2018A030313100)+1 种基金Shenzhen Science and Technology Program(Nos.JSGG20170414112714341 and JCYJ20170302153015013)Research Grants Council of the Hong Kong Special Administrative Region(No.14225616).
文摘This paper presents a novel augmented reality(AR)-based neurosurgical training simulator which provides a very natural way for surgeons to learn neurosurgical skills.Surgical simulation with bimanual haptic interaction is integrated in this work to provide a simulated environment for users to achieve holographic guidance for pre-operative training.To achieve the AR guidance,the simulator should precisely overlay the 3D anatomical information of the hidden target organs in the patients in real surgery.In this regard,the patient-specific anatomy structures are reconstructed from segmented brain magnetic resonance imaging.We propose a registration method for precise mapping of the virtual and real information.In addition,the simulator provides bimanual haptic interaction in a holographic environment to mimic real brain tumor resection.In this study,we conduct AR-based guidance validation and a user study on the developed simulator,which demonstrate the high accuracy of our AR-based neurosurgery simulator,as well as the AR guidance mode’s potential to improve neurosurgery by simplifying the operation,reducing the difficulty of the operation,shortening the operation time,and increasing the precision of the operation.
