骨盆CT影像精确分割是骨盆骨疾病的临床诊断和手术规划中非常重要的环节。针对目前2D骨盆分割方法对三维医学影像进行切片处理时损失空间信息的问题,提出了改进3D U-Net网络实现对骨盆CT影像3D自动分割。实验数据为公开数据集CTPelvic1K...骨盆CT影像精确分割是骨盆骨疾病的临床诊断和手术规划中非常重要的环节。针对目前2D骨盆分割方法对三维医学影像进行切片处理时损失空间信息的问题,提出了改进3D U-Net网络实现对骨盆CT影像3D自动分割。实验数据为公开数据集CTPelvic1K共1184名患者骨盆CT影像,其中包含骶骨、左髋骨、右髋骨和腰椎四个部位标签。以3D U-Net骨干网络为基础,结合自注意力机制提出3D多类分割模型3D Trans U-Net,并使用迁移学习训练3D U-Net、V-Net、Attention U-Net作为对照实验。实验结果表明:3D Trans U-Net在测试集上整个骨盆区域、骶骨、左髋骨、右髋骨、腰椎Dice系数分别达到97.99%,96.70%,97.96%,97.95%,96.89%;Dice系数、豪斯多夫距离等评价指标均优于现有经典网络3D U-Net、V-Net、Attention U-Net。因此,改进的3D Trans U-Net对骨盆不同部位具有较好的分割效果,为精准医治骨盆骨疾病提供了一条有效的技术途径。展开更多
With the widespread application of deep learning in the field of computer vision,gradually allowing medical image technology to assist doctors in making diagnoses has great practical and research significance.Aiming a...With the widespread application of deep learning in the field of computer vision,gradually allowing medical image technology to assist doctors in making diagnoses has great practical and research significance.Aiming at the shortcomings of the traditional U-Net model in 3D spatial information extraction,model over-fitting,and low degree of semantic information fusion,an improved medical image segmentation model has been used to achieve more accurate segmentation of medical images.In this model,we make full use of the residual network(ResNet)to solve the over-fitting problem.In order to process and aggregate data at different scales,the inception network is used instead of the traditional convolutional layer,and the dilated convolution is used to increase the receptive field.The conditional random field(CRF)can complete the contour refinement work.Compared with the traditional 3D U-Net network,the segmentation accuracy of the improved liver and tumor images increases by 2.89%and 7.66%,respectively.As a part of the image processing process,the method in this paper not only can be used for medical image segmentation,but also can lay the foundation for subsequent image 3D reconstruction work.展开更多
The semantic segmentation of a brain tumor is the essential stage in medical treatment planning. Due to the different characteristics of tumors, one of the main difficulties in image segmentation is the severe imbalan...The semantic segmentation of a brain tumor is the essential stage in medical treatment planning. Due to the different characteristics of tumors, one of the main difficulties in image segmentation is the severe imbalance between classes. Also, a dataset with imbalanced classes is a common problem in multimodal 3D brain MRIs. Despite these problems, most studies in brain tumor segmentation are biased toward the overrepresented tumor class (majority class) and ignore the small size tumor class (minority class). In this paper, we propose an improved loss function Weighted Focal Loss (WFL), based on 3D U-Net to enhance the prediction of brain tumor segmentation. Using our proposed loss function (WFL) solves the imbalance between classes and the imbalance between weights by giving higher weights to the minority and lower weights to the majority. After assigning these weights to different pixel values, our work is able to resolve pixel degradation, which is one of the limitations of the loss function during model training. Based on our experiments, the proposed function (WFL) on the 3D U-Net model for high-grade glioma (HGG) and low-grade glioma (LGG) in the Brain Tumor Segmentation Challenge (BraTS) 2019 dataset has shown promising results for tumor core (TC), whole tumor (WT) and enhanced tumor (ET) with average dice scores of HGG: 0.830, 0.913, 0.815 and Dice scores of LGG for TC: 0.731, WT: 0.775 and ET: 0.685. Moreover, we deployed our training on BraTS 2020 in which we obtained mean Dice scores of HGG: TC: 0.843, WT: 0.892, ET: 0.871 and Dice scores of LGG: 0.7501, 0.7985, 0.6103 for TC, WT and ET, respectively.展开更多
Deep learning, especially through convolutional neural networks (CNN) such as the U-Net 3D model, has revolutionized fault identification from seismic data, representing a significant leap over traditional methods. Ou...Deep learning, especially through convolutional neural networks (CNN) such as the U-Net 3D model, has revolutionized fault identification from seismic data, representing a significant leap over traditional methods. Our review traces the evolution of CNN, emphasizing the adaptation and capabilities of the U-Net 3D model in automating seismic fault delineation with unprecedented accuracy. We find: 1) The transition from basic neural networks to sophisticated CNN has enabled remarkable advancements in image recognition, which are directly applicable to analyzing seismic data. The U-Net 3D model, with its innovative architecture, exemplifies this progress by providing a method for detailed and accurate fault detection with reduced manual interpretation bias. 2) The U-Net 3D model has demonstrated its superiority over traditional fault identification methods in several key areas: it has enhanced interpretation accuracy, increased operational efficiency, and reduced the subjectivity of manual methods. 3) Despite these achievements, challenges such as the need for effective data preprocessing, acquisition of high-quality annotated datasets, and achieving model generalization across different geological conditions remain. Future research should therefore focus on developing more complex network architectures and innovative training strategies to refine fault identification performance further. Our findings confirm the transformative potential of deep learning, particularly CNN like the U-Net 3D model, in geosciences, advocating for its broader integration to revolutionize geological exploration and seismic analysis.展开更多
To solve the problems of convolutional neural network–principal component analysis(CNN-PCA)in fine description and generalization of complex reservoir geological features,a 3D attention U-Net network was proposed not...To solve the problems of convolutional neural network–principal component analysis(CNN-PCA)in fine description and generalization of complex reservoir geological features,a 3D attention U-Net network was proposed not using a trained C3D video motion analysis model to extract the style of a 3D model,and applied to complement the details of geologic model lost in the dimension reduction of PCA method in this study.The 3D attention U-Net network was applied to a complex river channel sandstone reservoir to test its effects.The results show that compared with CNN-PCA method,the 3D attention U-Net network could better complement the details of geological model lost in the PCA dimension reduction,better reflect the fluid flow features in the original geologic model,and improve history matching results.展开更多
文摘骨盆CT影像精确分割是骨盆骨疾病的临床诊断和手术规划中非常重要的环节。针对目前2D骨盆分割方法对三维医学影像进行切片处理时损失空间信息的问题,提出了改进3D U-Net网络实现对骨盆CT影像3D自动分割。实验数据为公开数据集CTPelvic1K共1184名患者骨盆CT影像,其中包含骶骨、左髋骨、右髋骨和腰椎四个部位标签。以3D U-Net骨干网络为基础,结合自注意力机制提出3D多类分割模型3D Trans U-Net,并使用迁移学习训练3D U-Net、V-Net、Attention U-Net作为对照实验。实验结果表明:3D Trans U-Net在测试集上整个骨盆区域、骶骨、左髋骨、右髋骨、腰椎Dice系数分别达到97.99%,96.70%,97.96%,97.95%,96.89%;Dice系数、豪斯多夫距离等评价指标均优于现有经典网络3D U-Net、V-Net、Attention U-Net。因此,改进的3D Trans U-Net对骨盆不同部位具有较好的分割效果,为精准医治骨盆骨疾病提供了一条有效的技术途径。
文摘With the widespread application of deep learning in the field of computer vision,gradually allowing medical image technology to assist doctors in making diagnoses has great practical and research significance.Aiming at the shortcomings of the traditional U-Net model in 3D spatial information extraction,model over-fitting,and low degree of semantic information fusion,an improved medical image segmentation model has been used to achieve more accurate segmentation of medical images.In this model,we make full use of the residual network(ResNet)to solve the over-fitting problem.In order to process and aggregate data at different scales,the inception network is used instead of the traditional convolutional layer,and the dilated convolution is used to increase the receptive field.The conditional random field(CRF)can complete the contour refinement work.Compared with the traditional 3D U-Net network,the segmentation accuracy of the improved liver and tumor images increases by 2.89%and 7.66%,respectively.As a part of the image processing process,the method in this paper not only can be used for medical image segmentation,but also can lay the foundation for subsequent image 3D reconstruction work.
文摘The semantic segmentation of a brain tumor is the essential stage in medical treatment planning. Due to the different characteristics of tumors, one of the main difficulties in image segmentation is the severe imbalance between classes. Also, a dataset with imbalanced classes is a common problem in multimodal 3D brain MRIs. Despite these problems, most studies in brain tumor segmentation are biased toward the overrepresented tumor class (majority class) and ignore the small size tumor class (minority class). In this paper, we propose an improved loss function Weighted Focal Loss (WFL), based on 3D U-Net to enhance the prediction of brain tumor segmentation. Using our proposed loss function (WFL) solves the imbalance between classes and the imbalance between weights by giving higher weights to the minority and lower weights to the majority. After assigning these weights to different pixel values, our work is able to resolve pixel degradation, which is one of the limitations of the loss function during model training. Based on our experiments, the proposed function (WFL) on the 3D U-Net model for high-grade glioma (HGG) and low-grade glioma (LGG) in the Brain Tumor Segmentation Challenge (BraTS) 2019 dataset has shown promising results for tumor core (TC), whole tumor (WT) and enhanced tumor (ET) with average dice scores of HGG: 0.830, 0.913, 0.815 and Dice scores of LGG for TC: 0.731, WT: 0.775 and ET: 0.685. Moreover, we deployed our training on BraTS 2020 in which we obtained mean Dice scores of HGG: TC: 0.843, WT: 0.892, ET: 0.871 and Dice scores of LGG: 0.7501, 0.7985, 0.6103 for TC, WT and ET, respectively.
文摘Deep learning, especially through convolutional neural networks (CNN) such as the U-Net 3D model, has revolutionized fault identification from seismic data, representing a significant leap over traditional methods. Our review traces the evolution of CNN, emphasizing the adaptation and capabilities of the U-Net 3D model in automating seismic fault delineation with unprecedented accuracy. We find: 1) The transition from basic neural networks to sophisticated CNN has enabled remarkable advancements in image recognition, which are directly applicable to analyzing seismic data. The U-Net 3D model, with its innovative architecture, exemplifies this progress by providing a method for detailed and accurate fault detection with reduced manual interpretation bias. 2) The U-Net 3D model has demonstrated its superiority over traditional fault identification methods in several key areas: it has enhanced interpretation accuracy, increased operational efficiency, and reduced the subjectivity of manual methods. 3) Despite these achievements, challenges such as the need for effective data preprocessing, acquisition of high-quality annotated datasets, and achieving model generalization across different geological conditions remain. Future research should therefore focus on developing more complex network architectures and innovative training strategies to refine fault identification performance further. Our findings confirm the transformative potential of deep learning, particularly CNN like the U-Net 3D model, in geosciences, advocating for its broader integration to revolutionize geological exploration and seismic analysis.
基金Supported by the China National Oil and Gas Major Project(2016ZX05010-003)PetroChina Science and Technology Major Project(2019B1210,2021DJ1201).
文摘To solve the problems of convolutional neural network–principal component analysis(CNN-PCA)in fine description and generalization of complex reservoir geological features,a 3D attention U-Net network was proposed not using a trained C3D video motion analysis model to extract the style of a 3D model,and applied to complement the details of geologic model lost in the dimension reduction of PCA method in this study.The 3D attention U-Net network was applied to a complex river channel sandstone reservoir to test its effects.The results show that compared with CNN-PCA method,the 3D attention U-Net network could better complement the details of geological model lost in the PCA dimension reduction,better reflect the fluid flow features in the original geologic model,and improve history matching results.
