基于深度学习实现磁控胶囊内镜操作质量控制的可行性研究

A retrospective feasibility study of a quality-control system for real-time supervision of magnetically controlled capsule endoscopy based on deep learning

目的开发一套基于深度学习的人工智能辅助质量控制系统,实现磁控胶囊胃镜检查过程实时质量控制。方法回顾性纳入山东大学齐鲁医院、山东美兆健康科技、莒县美年大健康三家内镜中心2019年1月至2020年1月共320例患者磁控胶囊胃镜检查图像资料,经内镜医师标注,基于Resnet-50开发出一套磁控胶囊胃镜辅助质量控制系统,实时进行检查完整度,部位清洁度,检查时间等指标监控,同时向操作者反馈检查质量,规范内镜操作者检查过程,实现磁控胶囊胃镜检查的质量控制。结果该磁控胶囊胃镜辅助质量控制系统识别胃内6解剖部位准确度为92.30~98.28%,4类清洁度识别准确度为91.46~95.37%,实际外部磁场操作时间计时准确度可达100%。同时,该质控系统整合至磁控操作系统,可安全运行。结论磁控胶囊胃镜辅助质量控制系统可实现质量控制,实时向内镜操作员反馈检查质量,规范内镜操作过程。

Objective To construct a real-time quality-control system during the stage of magnetically controlled capsule endoscopy for supervision based on deep learning.Methods A total of 320 patients with magnetically controlled capsule endoscopy image data were retrospectively included from January 2019 to January 2020 in endoscopy center of Qilu Hospital of Shandong University,Shandong Meizhao Healthy Technology and Juxian Meinian Onehealth Healthcare Holdings.After labeling by experienced endoscopists according to the guideline published in China,a real-time quality-control system including completeness with cleanliness and operation time report was developed based on the Resnet-50 model.With the help of real-time quality-control system,the operator can modulate the inspection process in terms of feedback information provided by quality-control system.Results The accuracy of a real-time quality-control system in identifying six anatomical parts of the gastric ranged from 92.30%to 98.28%,the accuracy of system in recognizing four types of mucosal cleanliness ranged from 91.46%to 95.37%,and the accuracy of timing of actual external magnetic field operation time was 100%.Meanwhile this system can be integrated into the magnetic control operating system safely and efficiently.Conclusion The real-time quality-control system of magnetically controlled capsule endoscopy can achieve the quality control function in the real-time inspection process,and provide real-time feedback to the endoscopic operator besides provide guidance and help for endoscopic operation.