Robotic intra-operative ultrasound has the potential to improve the conventional practice of diagnosis and procedure guidance that are currently performed manually.Working towards automatic or semi-automatic ultrasoun...Robotic intra-operative ultrasound has the potential to improve the conventional practice of diagnosis and procedure guidance that are currently performed manually.Working towards automatic or semi-automatic ultrasound,being able to define ultrasound views and the corresponding probe poses via intelligent approaches become crucial.Based on the concept of parallel system which incorporates the ingredients of artificial systems,computational experiments,and parallel execution,this paper utilized a recent developed robotic trans-esophageal ultrasound system as the study object to explore the method for developing the corresponding virtual environments and present the potential applications of such systems.The proposed virtual system includes the use of 3 D slicer as the main workspace and graphic user interface(GUI),Matlab engine to provide robotic control algorithms and customized functions,and PLUS(Public software Library for Ultra Sound imaging research)toolkit to generate simulated ultrasound images.Detailed implementation methods were presented and the proposed features of the system were explained.Based on this virtual system,example uses and case studies were presented to demonstrate its capabilities when used together with the physical TEE robot.This includes standard view definition and customized view optimization for pre-planning and navigation,as well as robotic control algorithm evaluations to facilitate real-time automatic probe pose adjustments.To conclude,the proposed virtual system would be a powerful tool to facilitate the further developments and clinical uses of the robotic intra-operative ultrasound systems.展开更多
基金supported in part by the Key Research and Development Program2020 of Guangzhou(202007050002)the National Natural Science Foundation of China(62003339,U1811463)the Intel Collaborative Research Institute for Intelligent and Automated Connected Vehicles(“ICRI-IACV”)。
文摘Robotic intra-operative ultrasound has the potential to improve the conventional practice of diagnosis and procedure guidance that are currently performed manually.Working towards automatic or semi-automatic ultrasound,being able to define ultrasound views and the corresponding probe poses via intelligent approaches become crucial.Based on the concept of parallel system which incorporates the ingredients of artificial systems,computational experiments,and parallel execution,this paper utilized a recent developed robotic trans-esophageal ultrasound system as the study object to explore the method for developing the corresponding virtual environments and present the potential applications of such systems.The proposed virtual system includes the use of 3 D slicer as the main workspace and graphic user interface(GUI),Matlab engine to provide robotic control algorithms and customized functions,and PLUS(Public software Library for Ultra Sound imaging research)toolkit to generate simulated ultrasound images.Detailed implementation methods were presented and the proposed features of the system were explained.Based on this virtual system,example uses and case studies were presented to demonstrate its capabilities when used together with the physical TEE robot.This includes standard view definition and customized view optimization for pre-planning and navigation,as well as robotic control algorithm evaluations to facilitate real-time automatic probe pose adjustments.To conclude,the proposed virtual system would be a powerful tool to facilitate the further developments and clinical uses of the robotic intra-operative ultrasound systems.
