The progress in medical imaging technology highlights the importance of image quality for effective diagnosis and treatment.Yet,noise during capture and transmission can compromise image accuracy and reliability,compl...The progress in medical imaging technology highlights the importance of image quality for effective diagnosis and treatment.Yet,noise during capture and transmission can compromise image accuracy and reliability,complicating clinical decisions.The rising interest in diffusion models has led to their exploration of denoising images.We present Be-FOI(Better Fluoro Images),a weakly supervised model that uses cine images to denoise fluoroscopic images,both DR types.Trained through precise noise estimation and simulation,BeFOI employs Markov chains to denoise using only the fluoroscopic image as guidance.Our tests show that BeFOI outperforms other methods,reducing noise and enhancing clar-ity and diagnostic utility,making it an effective post-processing tool for medical images.展开更多
Deep learning (DL) has seen an exponential development in recent years, with major impact in many medical fields, especially in the field of medical image. The purpose of the work converges in determining the importan...Deep learning (DL) has seen an exponential development in recent years, with major impact in many medical fields, especially in the field of medical image. The purpose of the work converges in determining the importance of each component, describing the specificity and correlations of these elements involved in achieving the precision of interpretation of medical images using DL. The major contribution of this work is primarily to the updated characterisation of the characteristics of the constituent elements of the deep learning process, scientific data, methods of knowledge incorporation, DL models according to the objectives for which they were designed and the presentation of medical applications in accordance with these tasks. Secondly, it describes the specific correlations between the quality, type and volume of data, the deep learning patterns used in the interpretation of diagnostic medical images and their applications in medicine. Finally presents problems and directions of future research. Data quality and volume, annotations and labels, identification and automatic extraction of specific medical terms can help deep learning models perform image analysis tasks. Moreover, the development of models capable of extracting unattended features and easily incorporated into the architecture of DL networks and the development of techniques to search for a certain network architecture according to the objectives set lead to performance in the interpretation of medical images.展开更多
With the widespread application of deep learning in the field of computer vision,gradually allowing medical image technology to assist doctors in making diagnoses has great practical and research significance.Aiming a...With the widespread application of deep learning in the field of computer vision,gradually allowing medical image technology to assist doctors in making diagnoses has great practical and research significance.Aiming at the shortcomings of the traditional U-Net model in 3D spatial information extraction,model over-fitting,and low degree of semantic information fusion,an improved medical image segmentation model has been used to achieve more accurate segmentation of medical images.In this model,we make full use of the residual network(ResNet)to solve the over-fitting problem.In order to process and aggregate data at different scales,the inception network is used instead of the traditional convolutional layer,and the dilated convolution is used to increase the receptive field.The conditional random field(CRF)can complete the contour refinement work.Compared with the traditional 3D U-Net network,the segmentation accuracy of the improved liver and tumor images increases by 2.89%and 7.66%,respectively.As a part of the image processing process,the method in this paper not only can be used for medical image segmentation,but also can lay the foundation for subsequent image 3D reconstruction work.展开更多
This paper proposes a practical algorithms of plane cutting, stereo clipping and arbitrary cutting for 3D surface model reconstructed from medical images. In plane cutting and stereo clipping algorithms, the 3D model ...This paper proposes a practical algorithms of plane cutting, stereo clipping and arbitrary cutting for 3D surface model reconstructed from medical images. In plane cutting and stereo clipping algorithms, the 3D model is cut by plane or polyhedron. Lists of edge and vertex in every cut plane are established. From these lists the boundary contours are created and their relationship of embrace is ascertained. The region closed by the contours is triangulated using Delaunay triangulation algorithm. Arbitrary cutting operation creates cutting curve interactively. The cut model still maintains its correct topology structure. With these operations, tissues inside can be observed easily and it can aid doctors to diagnose. The methods can also be used in surgery planning of radiotherapy.展开更多
In order to develop precision or personalized medicine,identifying new quantitative imaging markers and building machine learning models to predict cancer risk and prognosis has been attracting broad research interest...In order to develop precision or personalized medicine,identifying new quantitative imaging markers and building machine learning models to predict cancer risk and prognosis has been attracting broad research interest recently.Most of these research approaches use the similar concepts of the conventional computer-aided detection schemes of medical images,which include steps in detecting and segmenting suspicious regions or tumors,followed by training machine learning models based on the fusion of multiple image features computed from the segmented regions or tumors.However,due to the heterogeneity and boundary fuzziness of the suspicious regions or tumors,segmenting subtle regions is often difficult and unreliable.Additionally,ignoring global and/or background parenchymal tissue characteristics may also be a limitation of the conventional approaches.In our recent studies,we investigated the feasibility of developing new computer-aided schemes implemented with the machine learning models that are trained by global image features to predict cancer risk and prognosis.We trained and tested several models using images obtained from full-field digital mammography,magnetic resonance imaging,and computed tomography of breast,lung,and ovarian cancers.Study results showed that many of these new models yielded higher performance than other approaches used in current clinical practice.Furthermore,the computed global image features also contain complementary information from the features computed from the segmented regions or tumors in predicting cancer prognosis.Therefore,the global image features can be used alone to develop new case-based prediction models or can be added to current tumor-based models to increase their discriminatory power.展开更多
Medical imaging is crucial in modern clinics to provide guidance to the diagnosis and treatment of diseases.Medical image reconstruction is one of the most fundamental and important components of medical imaging,whose...Medical imaging is crucial in modern clinics to provide guidance to the diagnosis and treatment of diseases.Medical image reconstruction is one of the most fundamental and important components of medical imaging,whose major objective is to acquire high-quality medical images for clinical usage at the minimal cost and risk to the patients.Mathematical models in medical image reconstruction or,more generally,image restoration in computer vision have been playing a prominent role.Earlier mathematical models are mostly designed by human knowledge or hypothesis on the image to be reconstructed,and we shall call these models handcrafted models.Later,handcrafted plus data-driven modeling started to emerge which still mostly relies on human designs,while part of the model is learned from the observed data.More recently,as more data and computation resources are made available,deep learning based models(or deep models)pushed the data-driven modeling to the extreme where the models are mostly based on learning with minimal human designs.Both handcrafted and data-driven modeling have their own advantages and disadvantages.Typical handcrafted models are well interpretable with solid theoretical supports on the robustness,recoverability,complexity,etc.,whereas they may not be flexible and sophisticated enough to fully leverage large data sets.Data-driven models,especially deep models,on the other hand,are generally much more flexible and effective in extracting useful information from large data sets,while they are currently still in lack of theoretical foundations.Therefore,one of the major research trends in medical imaging is to combine handcrafted modeling with deep modeling so that we can enjoy benefits from both approaches.The major part of this article is to provide a conceptual review of some recent works on deep modeling from the unrolling dynamics viewpoint.This viewpoint stimulates new designs of neural network architectures with inspirations from optimization algorithms and numerical differential equations.Given the popularity of deep modeling,there are still vast remaining challenges in the field,as well as opportunities which we shall discuss at the end of this article.展开更多
Medical image segmentation is one of the key technologies in computer aided diagnosis. Due to the complexity and diversity of medical images, the wavelet multi-scale analysis is introduced into GVF (gradient vector fl...Medical image segmentation is one of the key technologies in computer aided diagnosis. Due to the complexity and diversity of medical images, the wavelet multi-scale analysis is introduced into GVF (gradient vector flow) snake model. The modulus values of each scale and phase angle values are calculated using wavelet transform, and the local maximum points of modulus values, which are the contours of the object edges, are obtained along phase angle direction at each scale. Then, location of the edges of the object and segmentation is implemented by GVF snake model. The experiments on some medical images show that the improved algorithm has small amount of computation, fast convergence and good robustness to noise.展开更多
Deep learning (DL) has experienced an exponential development in recent years, with major impact in many medical fields, especially in the field of medical image and, respectively, as a specific task, in the segmentat...Deep learning (DL) has experienced an exponential development in recent years, with major impact in many medical fields, especially in the field of medical image and, respectively, as a specific task, in the segmentation of the medical image. We aim to create a computer assisted diagnostic method, optimized by the use of deep learning (DL) and validated by a randomized controlled clinical trial, is a highly automated tool for diagnosing and staging precancerous and cervical cancer and thyroid cancers. We aim to design a high-performance deep learning model, combined from convolutional neural network (U-Net)-based architectures, for segmentation of the medical image that is independent of the type of organs/tissues, dimensions or type of image (2D/3D) and to validate the DL model in a randomized, controlled clinical trial. We used as a methodology primarily the analysis of U-Net-based architectures to identify the key elements that we considered important in the design and optimization of the combined DL model, from the U-Net-based architectures, imagined by us. Secondly, we will validate the performance of the DL model through a randomized controlled clinical trial. The DL model designed by us will be a highly automated tool for diagnosing and staging precancers and cervical cancer and thyroid cancers. The combined model we designed takes into account the key features of each of the architectures Overcomplete Convolutional Network Kite-Net (Kite-Net), Attention gate mechanism is an improvement added on convolutional network architecture for fast and precise segmentation of images (Attention U-Net), Harmony Densely Connected Network-Medical image Segmentation (HarDNet-MSEG). In this regard, we will create a comprehensive computer assisted diagnostic methodology validated by a randomized controlled clinical trial. The model will be a highly automated tool for diagnosing and staging precancers and cervical cancer and thyroid cancers. This would help drastically minimize the time and effort that specialists put into analyzing medical images, help to achieve a better therapeutic plan, and can provide a “second opinion” of computer assisted diagnosis.展开更多
Covid-19 is a deadly virus that is rapidly spread around the world towards the end of the 2020.The consequences of this virus are quite frightening,especially when accompanied by an underlying disease.The novelty of t...Covid-19 is a deadly virus that is rapidly spread around the world towards the end of the 2020.The consequences of this virus are quite frightening,especially when accompanied by an underlying disease.The novelty of the virus,the constant emergence of different variants and its rapid spread have a negative impact on the control and treatment process.Although the new test kits provide almost certain results,chest X-rays are extremely important to detect the progression and degree of the disease.In addition to the Covid-19 virus,pneumonia and harmless opacity of the lungs also complicate the diagnosis.Considering the negative results caused by the virus and the treatment costs,the importance of fast and accurate diagnosis is clearly seen.In this context,deep learning methods appear as an extremely popular approach.In this study,a hybrid model design with superior properties of convolutional neural networks is presented to correctly classify the Covid-19 disease.In addition,in order to contribute to the literature,a suitable dataset with balanced case numbers that can be used in all artificial intelligence classification studies is presented.With this ensemble model design,quite remarkable results are obtained for the diagnosis of three and four-class Covid-19.The proposed model can classify normal,pneumonia,and Covid-19 with 92.6%accuracy and 82.6%for normal,pneumonia,Covid-19,and lung opacity.展开更多
医学影像学是临床医学中一门实践性极强辅助学科,同时也是发展迅猛,日新月异的学科,在现代医疗中扮演着越来越重要的角色。文章通过对影像医学教学的基本要求、教学目标和目的进行说明,采用影像存储和传输系统(picture archiving and co...医学影像学是临床医学中一门实践性极强辅助学科,同时也是发展迅猛,日新月异的学科,在现代医疗中扮演着越来越重要的角色。文章通过对影像医学教学的基本要求、教学目标和目的进行说明,采用影像存储和传输系统(picture archiving and communication system,PACS)结合以问题为基础的教学法(problem-based learning,PBL)及以案例为基础的教学法(case-based learning,CBL)教学法进行实践。针对非影像专业学员学习时间短、学习任务重,学员影像基础和需求迥异,部分非影像专业学员自身对医学影像学的重视不足以及放射基地重视不足等问题。文章阐述了PACS与PBL、CBL教学法、钉钉、微信及SPARK学习平台等学习沟通平台相结合,并增加专职人员对基地管理、带教老师一对一指导,以及不断加强科室建设、安排名师上课来提高科室影响力等多种混合教学模式的解决对策,来唤起学员学习影像相关知识的内驱力,达到提高学员轮转学习效果的目的。展开更多
文摘The progress in medical imaging technology highlights the importance of image quality for effective diagnosis and treatment.Yet,noise during capture and transmission can compromise image accuracy and reliability,complicating clinical decisions.The rising interest in diffusion models has led to their exploration of denoising images.We present Be-FOI(Better Fluoro Images),a weakly supervised model that uses cine images to denoise fluoroscopic images,both DR types.Trained through precise noise estimation and simulation,BeFOI employs Markov chains to denoise using only the fluoroscopic image as guidance.Our tests show that BeFOI outperforms other methods,reducing noise and enhancing clar-ity and diagnostic utility,making it an effective post-processing tool for medical images.
文摘Deep learning (DL) has seen an exponential development in recent years, with major impact in many medical fields, especially in the field of medical image. The purpose of the work converges in determining the importance of each component, describing the specificity and correlations of these elements involved in achieving the precision of interpretation of medical images using DL. The major contribution of this work is primarily to the updated characterisation of the characteristics of the constituent elements of the deep learning process, scientific data, methods of knowledge incorporation, DL models according to the objectives for which they were designed and the presentation of medical applications in accordance with these tasks. Secondly, it describes the specific correlations between the quality, type and volume of data, the deep learning patterns used in the interpretation of diagnostic medical images and their applications in medicine. Finally presents problems and directions of future research. Data quality and volume, annotations and labels, identification and automatic extraction of specific medical terms can help deep learning models perform image analysis tasks. Moreover, the development of models capable of extracting unattended features and easily incorporated into the architecture of DL networks and the development of techniques to search for a certain network architecture according to the objectives set lead to performance in the interpretation of medical images.
文摘With the widespread application of deep learning in the field of computer vision,gradually allowing medical image technology to assist doctors in making diagnoses has great practical and research significance.Aiming at the shortcomings of the traditional U-Net model in 3D spatial information extraction,model over-fitting,and low degree of semantic information fusion,an improved medical image segmentation model has been used to achieve more accurate segmentation of medical images.In this model,we make full use of the residual network(ResNet)to solve the over-fitting problem.In order to process and aggregate data at different scales,the inception network is used instead of the traditional convolutional layer,and the dilated convolution is used to increase the receptive field.The conditional random field(CRF)can complete the contour refinement work.Compared with the traditional 3D U-Net network,the segmentation accuracy of the improved liver and tumor images increases by 2.89%and 7.66%,respectively.As a part of the image processing process,the method in this paper not only can be used for medical image segmentation,but also can lay the foundation for subsequent image 3D reconstruction work.
基金This research was supported by the National Nature Science Foundation of China under Grant No.60473024 the Nature Science Foundation of Zhejiang Province of China under Grant No.Y104341 and z105391.
文摘This paper proposes a practical algorithms of plane cutting, stereo clipping and arbitrary cutting for 3D surface model reconstructed from medical images. In plane cutting and stereo clipping algorithms, the 3D model is cut by plane or polyhedron. Lists of edge and vertex in every cut plane are established. From these lists the boundary contours are created and their relationship of embrace is ascertained. The region closed by the contours is triangulated using Delaunay triangulation algorithm. Arbitrary cutting operation creates cutting curve interactively. The cut model still maintains its correct topology structure. With these operations, tissues inside can be observed easily and it can aid doctors to diagnose. The methods can also be used in surgery planning of radiotherapy.
基金The studies mentioned in this paper were supported in part by Grants R01 CA160205 and R01 CA197150 from the National Cancer Institute,National Institutes of Health,USAGrant HR15-016 from Oklahoma Center for the Advancement of Science and Technology,USA.
文摘In order to develop precision or personalized medicine,identifying new quantitative imaging markers and building machine learning models to predict cancer risk and prognosis has been attracting broad research interest recently.Most of these research approaches use the similar concepts of the conventional computer-aided detection schemes of medical images,which include steps in detecting and segmenting suspicious regions or tumors,followed by training machine learning models based on the fusion of multiple image features computed from the segmented regions or tumors.However,due to the heterogeneity and boundary fuzziness of the suspicious regions or tumors,segmenting subtle regions is often difficult and unreliable.Additionally,ignoring global and/or background parenchymal tissue characteristics may also be a limitation of the conventional approaches.In our recent studies,we investigated the feasibility of developing new computer-aided schemes implemented with the machine learning models that are trained by global image features to predict cancer risk and prognosis.We trained and tested several models using images obtained from full-field digital mammography,magnetic resonance imaging,and computed tomography of breast,lung,and ovarian cancers.Study results showed that many of these new models yielded higher performance than other approaches used in current clinical practice.Furthermore,the computed global image features also contain complementary information from the features computed from the segmented regions or tumors in predicting cancer prognosis.Therefore,the global image features can be used alone to develop new case-based prediction models or can be added to current tumor-based models to increase their discriminatory power.
基金The work of Hai-Miao Zhang was funded by China Postdoctoral Science Foundation(No.2018M641056)The work of Bin Dong was supported in part by the National Natural Science Foundation of China(No.11831002)Natural Science Foundation of Beijing(No.Z180001).
文摘Medical imaging is crucial in modern clinics to provide guidance to the diagnosis and treatment of diseases.Medical image reconstruction is one of the most fundamental and important components of medical imaging,whose major objective is to acquire high-quality medical images for clinical usage at the minimal cost and risk to the patients.Mathematical models in medical image reconstruction or,more generally,image restoration in computer vision have been playing a prominent role.Earlier mathematical models are mostly designed by human knowledge or hypothesis on the image to be reconstructed,and we shall call these models handcrafted models.Later,handcrafted plus data-driven modeling started to emerge which still mostly relies on human designs,while part of the model is learned from the observed data.More recently,as more data and computation resources are made available,deep learning based models(or deep models)pushed the data-driven modeling to the extreme where the models are mostly based on learning with minimal human designs.Both handcrafted and data-driven modeling have their own advantages and disadvantages.Typical handcrafted models are well interpretable with solid theoretical supports on the robustness,recoverability,complexity,etc.,whereas they may not be flexible and sophisticated enough to fully leverage large data sets.Data-driven models,especially deep models,on the other hand,are generally much more flexible and effective in extracting useful information from large data sets,while they are currently still in lack of theoretical foundations.Therefore,one of the major research trends in medical imaging is to combine handcrafted modeling with deep modeling so that we can enjoy benefits from both approaches.The major part of this article is to provide a conceptual review of some recent works on deep modeling from the unrolling dynamics viewpoint.This viewpoint stimulates new designs of neural network architectures with inspirations from optimization algorithms and numerical differential equations.Given the popularity of deep modeling,there are still vast remaining challenges in the field,as well as opportunities which we shall discuss at the end of this article.
文摘Medical image segmentation is one of the key technologies in computer aided diagnosis. Due to the complexity and diversity of medical images, the wavelet multi-scale analysis is introduced into GVF (gradient vector flow) snake model. The modulus values of each scale and phase angle values are calculated using wavelet transform, and the local maximum points of modulus values, which are the contours of the object edges, are obtained along phase angle direction at each scale. Then, location of the edges of the object and segmentation is implemented by GVF snake model. The experiments on some medical images show that the improved algorithm has small amount of computation, fast convergence and good robustness to noise.
文摘Deep learning (DL) has experienced an exponential development in recent years, with major impact in many medical fields, especially in the field of medical image and, respectively, as a specific task, in the segmentation of the medical image. We aim to create a computer assisted diagnostic method, optimized by the use of deep learning (DL) and validated by a randomized controlled clinical trial, is a highly automated tool for diagnosing and staging precancerous and cervical cancer and thyroid cancers. We aim to design a high-performance deep learning model, combined from convolutional neural network (U-Net)-based architectures, for segmentation of the medical image that is independent of the type of organs/tissues, dimensions or type of image (2D/3D) and to validate the DL model in a randomized, controlled clinical trial. We used as a methodology primarily the analysis of U-Net-based architectures to identify the key elements that we considered important in the design and optimization of the combined DL model, from the U-Net-based architectures, imagined by us. Secondly, we will validate the performance of the DL model through a randomized controlled clinical trial. The DL model designed by us will be a highly automated tool for diagnosing and staging precancers and cervical cancer and thyroid cancers. The combined model we designed takes into account the key features of each of the architectures Overcomplete Convolutional Network Kite-Net (Kite-Net), Attention gate mechanism is an improvement added on convolutional network architecture for fast and precise segmentation of images (Attention U-Net), Harmony Densely Connected Network-Medical image Segmentation (HarDNet-MSEG). In this regard, we will create a comprehensive computer assisted diagnostic methodology validated by a randomized controlled clinical trial. The model will be a highly automated tool for diagnosing and staging precancers and cervical cancer and thyroid cancers. This would help drastically minimize the time and effort that specialists put into analyzing medical images, help to achieve a better therapeutic plan, and can provide a “second opinion” of computer assisted diagnosis.
文摘Covid-19 is a deadly virus that is rapidly spread around the world towards the end of the 2020.The consequences of this virus are quite frightening,especially when accompanied by an underlying disease.The novelty of the virus,the constant emergence of different variants and its rapid spread have a negative impact on the control and treatment process.Although the new test kits provide almost certain results,chest X-rays are extremely important to detect the progression and degree of the disease.In addition to the Covid-19 virus,pneumonia and harmless opacity of the lungs also complicate the diagnosis.Considering the negative results caused by the virus and the treatment costs,the importance of fast and accurate diagnosis is clearly seen.In this context,deep learning methods appear as an extremely popular approach.In this study,a hybrid model design with superior properties of convolutional neural networks is presented to correctly classify the Covid-19 disease.In addition,in order to contribute to the literature,a suitable dataset with balanced case numbers that can be used in all artificial intelligence classification studies is presented.With this ensemble model design,quite remarkable results are obtained for the diagnosis of three and four-class Covid-19.The proposed model can classify normal,pneumonia,and Covid-19 with 92.6%accuracy and 82.6%for normal,pneumonia,Covid-19,and lung opacity.
文摘医学影像学是临床医学中一门实践性极强辅助学科,同时也是发展迅猛,日新月异的学科,在现代医疗中扮演着越来越重要的角色。文章通过对影像医学教学的基本要求、教学目标和目的进行说明,采用影像存储和传输系统(picture archiving and communication system,PACS)结合以问题为基础的教学法(problem-based learning,PBL)及以案例为基础的教学法(case-based learning,CBL)教学法进行实践。针对非影像专业学员学习时间短、学习任务重,学员影像基础和需求迥异,部分非影像专业学员自身对医学影像学的重视不足以及放射基地重视不足等问题。文章阐述了PACS与PBL、CBL教学法、钉钉、微信及SPARK学习平台等学习沟通平台相结合,并增加专职人员对基地管理、带教老师一对一指导,以及不断加强科室建设、安排名师上课来提高科室影响力等多种混合教学模式的解决对策,来唤起学员学习影像相关知识的内驱力,达到提高学员轮转学习效果的目的。
