Since the 1980s, various techniques have been used in the field of medicine for the post-processing of medical imaging data from computed tomography (CT) and magnetic resonance (MR). They include multiplanar reformati...Since the 1980s, various techniques have been used in the field of medicine for the post-processing of medical imaging data from computed tomography (CT) and magnetic resonance (MR). They include multiplanar reformations (MPR), maximum intensity projection (MIP) and Volume Rendering (VR). This paper presents the prototype of a new means of post-processing radiological examinations such as CT and MR, a technique that, for the first time, provides photorealistic visualizations of the human body. This new procedure was inspired by the quality of images achieved by animation software such as programs used in the entertainment industry, particularly to produce animated films. Thus, the name: Cinematic Rendering. It is already foreseeable that this new method of depiction will quickly be incorporated into the set of instruments employed in socalled virtual anatomy (teaching anatomy through the use of radiological depictions of the human body via X-ray, CT and MR in addition to the use of computer animation programs designed especially for human anatomy). Its potential for medical applications will have to be evaluated by future scientific investigations.展开更多
This paper presents a novel augmented reality(AR)-based neurosurgical training simulator which provides a very natural way for surgeons to learn neurosurgical skills.Surgical simulation with bimanual haptic interactio...This paper presents a novel augmented reality(AR)-based neurosurgical training simulator which provides a very natural way for surgeons to learn neurosurgical skills.Surgical simulation with bimanual haptic interaction is integrated in this work to provide a simulated environment for users to achieve holographic guidance for pre-operative training.To achieve the AR guidance,the simulator should precisely overlay the 3D anatomical information of the hidden target organs in the patients in real surgery.In this regard,the patient-specific anatomy structures are reconstructed from segmented brain magnetic resonance imaging.We propose a registration method for precise mapping of the virtual and real information.In addition,the simulator provides bimanual haptic interaction in a holographic environment to mimic real brain tumor resection.In this study,we conduct AR-based guidance validation and a user study on the developed simulator,which demonstrate the high accuracy of our AR-based neurosurgery simulator,as well as the AR guidance mode’s potential to improve neurosurgery by simplifying the operation,reducing the difficulty of the operation,shortening the operation time,and increasing the precision of the operation.展开更多
文摘Since the 1980s, various techniques have been used in the field of medicine for the post-processing of medical imaging data from computed tomography (CT) and magnetic resonance (MR). They include multiplanar reformations (MPR), maximum intensity projection (MIP) and Volume Rendering (VR). This paper presents the prototype of a new means of post-processing radiological examinations such as CT and MR, a technique that, for the first time, provides photorealistic visualizations of the human body. This new procedure was inspired by the quality of images achieved by animation software such as programs used in the entertainment industry, particularly to produce animated films. Thus, the name: Cinematic Rendering. It is already foreseeable that this new method of depiction will quickly be incorporated into the set of instruments employed in socalled virtual anatomy (teaching anatomy through the use of radiological depictions of the human body via X-ray, CT and MR in addition to the use of computer animation programs designed especially for human anatomy). Its potential for medical applications will have to be evaluated by future scientific investigations.
基金This study was funded by National Natural Science Foundation of China(No.61802385)Natural Science Foundation of Guangdong(No.2018A030313100)+1 种基金Shenzhen Science and Technology Program(Nos.JSGG20170414112714341 and JCYJ20170302153015013)Research Grants Council of the Hong Kong Special Administrative Region(No.14225616).
文摘This paper presents a novel augmented reality(AR)-based neurosurgical training simulator which provides a very natural way for surgeons to learn neurosurgical skills.Surgical simulation with bimanual haptic interaction is integrated in this work to provide a simulated environment for users to achieve holographic guidance for pre-operative training.To achieve the AR guidance,the simulator should precisely overlay the 3D anatomical information of the hidden target organs in the patients in real surgery.In this regard,the patient-specific anatomy structures are reconstructed from segmented brain magnetic resonance imaging.We propose a registration method for precise mapping of the virtual and real information.In addition,the simulator provides bimanual haptic interaction in a holographic environment to mimic real brain tumor resection.In this study,we conduct AR-based guidance validation and a user study on the developed simulator,which demonstrate the high accuracy of our AR-based neurosurgery simulator,as well as the AR guidance mode’s potential to improve neurosurgery by simplifying the operation,reducing the difficulty of the operation,shortening the operation time,and increasing the precision of the operation.