Improved Medical Image Segmentation Model Based on 3D U-Net

With the widespread application of deep learning in the field of computer vision,gradually allowing medical image technology to assist doctors in making diagnoses has great practical and research significance.Aiming at the shortcomings of the traditional U-Net model in 3D spatial information extraction,model over-fitting,and low degree of semantic information fusion,an improved medical image segmentation model has been used to achieve more accurate segmentation of medical images.In this model,we make full use of the residual network(ResNet)to solve the over-fitting problem.In order to process and aggregate data at different scales,the inception network is used instead of the traditional convolutional layer,and the dilated convolution is used to increase the receptive field.The conditional random field(CRF)can complete the contour refinement work.Compared with the traditional 3D U-Net network,the segmentation accuracy of the improved liver and tumor images increases by 2.89%and 7.66%,respectively.As a part of the image processing process,the method in this paper not only can be used for medical image segmentation,but also can lay the foundation for subsequent image 3D reconstruction work.

A network lightweighting method for difficult segmentation of 3D medical images

Currently,deep learning is widely used in medical image segmentation and has achieved good results.However,3D medical image segmentation tasks with diverse lesion characters,blurred edges,and unstable positions require complex networks with a large number of parameters.It is computationally expensive and results in high requirements on equipment,making it hard to deploy the network in hospitals.In this work,we propose a method for network lightweighting and applied it to a 3D CNN based network.We experimented on a COVID-19 lesion segmentation dataset.Specifically,we use three cascaded one-dimensional convolutions to replace a 3D convolution,and integrate instance normalization with the previous layer of one-dimensional convolutions to accelerate network inference.In addition,we simplify test-time augmentation and deep supervision of the network.Experiments show that the lightweight network can reduce the prediction time of each sample and the memory usage by 50%and reduce the number of parameters by 60%compared with the original network.The training time of one epoch is also reduced by 50%with the segmentation accuracy dropped within the acceptable range.

Mu-Net:Multi-Path Upsampling Convolution Network for Medical Image Segmentation

Medical image segmentation plays an important role in clinical diagnosis,quantitative analysis,and treatment process.Since 2015,U-Net-based approaches have been widely used formedical image segmentation.The purpose of the U-Net expansive path is to map low-resolution encoder feature maps to full input resolution feature maps.However,the consecutive deconvolution and convolutional operations in the expansive path lead to the loss of some high-level information.More high-level information can make the segmentationmore accurate.In this paper,we propose MU-Net,a novel,multi-path upsampling convolution network to retain more high-level information.The MU-Net mainly consists of three parts:contracting path,skip connection,and multi-expansive paths.The proposed MU-Net architecture is evaluated based on three different medical imaging datasets.Our experiments show that MU-Net improves the segmentation performance of U-Net-based methods on different datasets.At the same time,the computational efficiency is significantly improved by reducing the number of parameters by more than half.

Nuclei Segmentation in Histopathology Images Using Structure-Preserving Color Normalization Based Ensemble Deep Learning Frameworks

This paper presents a novel computerized technique for the segmentation of nuclei in hematoxylin and eosin(H&E)stained histopathology images.The purpose of this study is to overcome the challenges faced in automated nuclei segmentation due to the diversity of nuclei structures that arise from differences in tissue types and staining protocols,as well as the segmentation of variable-sized and overlapping nuclei.To this extent,the approach proposed in this study uses an ensemble of the UNet architecture with various Convolutional Neural Networks(CNN)architectures as encoder backbones,along with stain normalization and test time augmentation,to improve segmentation accuracy.Additionally,this paper employs a Structure-Preserving Color Normalization(SPCN)technique as a preprocessing step for stain normalization.The proposed model was trained and tested on both single-organ and multi-organ datasets,yielding an F1 score of 84.11%,mean Intersection over Union(IoU)of 81.67%,dice score of 84.11%,accuracy of 92.58%and precision of 83.78%on the multi-organ dataset,and an F1 score of 87.04%,mean IoU of 86.66%,dice score of 87.04%,accuracy of 96.69%and precision of 87.57%on the single-organ dataset.These findings demonstrate that the proposed model ensemble coupled with the right pre-processing and post-processing techniques enhances nuclei segmentation capabilities.

Semi-Supervised Medical Image Segmentation Based on Generative Adversarial Network

At present,segmentation for medical image is mainly based on fully supervised model training,which consumes a lot of time and labor for dataset labeling.To address this issue,we propose a semi-supervised medical image segmentation model based on a generative adversarial network framework for automated segmentation of arteries.The network is mainly composed of two parts:a segmentation network for medical image segmentation and a discriminant network for evaluating segmentation results.In the initial stage of network training,a fully supervised training method is adopted to make the segmentation network and the discrimination network have certain segmentation and discrimination capabilities.Then a semi-supervised method is adopted to train the model,in which the discriminant network will generate pseudo-labels on the results of the segmentation for semi-supervised training of the segmentation network.The proposed method can use a small part of annotated dataset to realize the segmentation of medical images and effectively solve the problem of insufficient medical image annotation data.

A U-Net-Based CNN Model for Detection and Segmentation of Brain Tumor

Human brain consists of millions of cells to control the overall structure of the human body.When these cells start behaving abnormally,then brain tumors occurred.Precise and initial stage brain tumor detection has always been an issue in the field of medicines for medical experts.To handle this issue,various deep learning techniques for brain tumor detection and segmentation techniques have been developed,which worked on different datasets to obtain fruitful results,but the problem still exists for the initial stage of detection of brain tumors to save human lives.For this purpose,we proposed a novel U-Net-based Convolutional Neural Network(CNN)technique to detect and segmentizes the brain tumor for Magnetic Resonance Imaging(MRI).Moreover,a 2-dimensional publicly available Multimodal Brain Tumor Image Segmentation(BRATS2020)dataset with 1840 MRI images of brain tumors has been used having an image size of 240×240 pixels.After initial dataset preprocessing the proposed model is trained by dividing the dataset into three parts i.e.,testing,training,and validation process.Our model attained an accuracy value of 0.98%on the BRATS2020 dataset,which is the highest one as compared to the already existing techniques.

CT Image Segmentation Method of Composite Material Based on Improved Watershed Algorithm and U-Net Neural Network Model

In the study of the composite materials performance,X-ray computed tomography(XCT)scanning has always been one of the important measures to detect the internal structures.CT image segmentation technology will effectively improve the accuracy of the subsequent material feature extraction process,which is of great significance to the study of material performance.This study focuses on the low accuracy problem of image segmentation caused by fiber cross-section adhesion in composite CT images.In the core layer area,area validity is evaluated by morphological indicator and an iterative segmentation strategy is proposed based on the watershed algorithm.In the transition layer area,a U-net neural network model trained by using artificial labels is applied to the prediction of segmentation result.Furthermore,a CT image segmentation method for fiber composite materials based on the improved watershed algorithm and the U-net model is proposed.It is verified by experiments that the method has good adaptability and effectiveness to the CT image segmentation problem of composite materials,and the accuracy of segmentation is significantly improved in comparison with the original method,which ensures the accuracy and robustness of the subsequent fiber feature extraction process.

Inner Cascaded U^(2)-Net:An Improvement to Plain Cascaded U-Net

Deep neural networks are now widely used in the medical image segmentation field for their performance superiority and no need of manual feature extraction.U-Net has been the baseline model since the very beginning due to a symmetricalU-structure for better feature extraction and fusing and suitable for small datasets.To enhance the segmentation performance of U-Net,cascaded U-Net proposes to put two U-Nets successively to segment targets from coarse to fine.However,the plain cascaded U-Net faces the problem of too less between connections so the contextual information learned by the former U-Net cannot be fully used by the latter one.In this article,we devise novel Inner Cascaded U-Net and Inner Cascaded U^(2)-Net as improvements to plain cascaded U-Net for medical image segmentation.The proposed Inner Cascaded U-Net adds inner nested connections between two U-Nets to share more contextual information.To further boost segmentation performance,we propose Inner Cascaded U^(2)-Net,which applies residual U-block to capture more global contextual information from different scales.The proposed models can be trained from scratch in an end-to-end fashion and have been evaluated on Multimodal Brain Tumor Segmentation Challenge(BraTS)2013 and ISBI Liver Tumor Segmentation Challenge(LiTS)dataset in comparison to related U-Net,cascaded U-Net,U-Net++,U^(2)-Net and state-of-the-art methods.Our experiments demonstrate that our proposed Inner Cascaded U-Net and Inner Cascaded U^(2)-Net achieve better segmentation performance in terms of dice similarity coefficient and hausdorff distance as well as get finer outline segmentation.

改进U-Net网络的多视觉图像特征张量分割仿真

针对图像分割计算量大、噪声因素影响等问题,提出改进U-Net网络的多视觉特征图像分割方法。对同一窗口中的灰度值排序,计算像素点极大值与极小值,根据角度与像素点的关系,检测噪声点,将被污染的噪声点放入集合中,使用其它像素点替换该点,完成滤波;分别从颜色、纹理与形状三个方面提取图像的多视觉特征,为图像分割提供参考依据;利用编码器、解码器和跳跃连接层建立U-Net网络,将提取的特征作为网络输入,新增深度残差模块,经过残差学习,实现特征映射;引入注意力模块,减少特征维度,确定张量权重,利用池化层拼接特征维度,输出最终分割特征张量。实验结果表明,所提方法对于分割目标的敏感度较高,不容易出现过分割与欠分割现象。

基于改进U-Net网络的光伏板图像分割方法

光伏板区域识别与分割对光伏板的缺陷精确检测和组件精准定位有重要意义.在复杂环境下,针对光伏板图像存在对比度不强、边界模糊、背景复杂等影响分割的问题,提出了一种改进U-Net网络的光伏板图像分割方法.首先,搭建基于U-Net网络的对称编码-解码结构骨干网络;其次,使用深度可分离卷积替代传统卷积,并将高效ECA注意力模块添加到两组深度可分离卷积之间,以两组深度可分离卷积和一个ECA注意力模块组成一个block块,利用多个block块提升多层网络的分割性能;之后,引入交叉熵损失、Dice损失、Focal损失线性加权和作为新的损失函数,训练改进U-Net网络;最后,为验证方法的有效性,将改进U-Net网络与MobileNetV2网络、U-Net网络、Res-U-Net网络分别在3 200张光伏板红外图像数据集上进行横向对比.结果表明:改进U-Net网络的PA值和MIoU值达到了0.993 1和0.980 2,均优于其他3种网络模型,且参数量只有U-Net网络和Res-U-Net网络的33.3%和30.4%,仅次于MobileNetV2网络.因此,改进U-Net网络具有较高的准确性和泛化性,能够完成光伏板图像分割任务.

基于跨模态注意力融合的煤炭异物检测方法

为解决原煤智能化洗选过程中煤流中夹杂的异物对比度低、相互遮挡导致异物图像检测时特征提取不充分的问题,提出了一种基于跨模态注意力融合的煤炭异物检测方法。通过引入Depth图像构建RGB图像与Depth图像的双特征金字塔网络(DFPN),采用浅层的特征提取策略提取Depth图像的低级特征,用深度边缘与深度纹理等基础特征辅助RGB图像深层特征,以有效获得2种特征的互补信息,从而丰富异物特征的空间与边缘信息,提高检测精度;构建了基于坐标注意力与改进空间注意力的跨模态注意力融合模块(CAFM),以协同优化并融合RGB特征与Depth特征,增强网络对特征图中被遮挡异物可见部分的关注度,提高被遮挡异物检测精度;使用区域卷积神经网络(R-CNN)输出煤炭异物的分类、回归与分割结果。实验结果表明:在检测精度方面,该方法的AP相较两阶段模型中较优的Mask transfiner高3.9%;在检测效率方面,该方法的单帧检测时间为110.5 ms,能够满足异物检测实时性需求。基于跨模态注意力融合的煤炭异物检测方法能够以空间特征辅助色彩、形状与纹理等特征,准确识别煤炭异物之间及煤炭异物与输送带之间的差异,从而有效提高对复杂特征异物的检测精度,减少误检、漏检现象,实现复杂特征下煤炭异物的精确检测与像素级分割。

基于U-Net结构改进的医学影像分割技术综述

深度学习在医学影像分割领域得到广泛应用,其中,2015年提出的U-Net因其分割小目标效果较好、结构具有可扩展性,自提出以来受到广泛关注.近年来,随着医学图像割性能要求的提升,众多学者针对U-Net结构也在不断地改进和扩展,比如编解码器的改进、外接特征金字塔等.通过对基于U-Net结构改进的医学影像分割技术,从面向性能优化和面向结构改进两个方面进行总结,对相关方法进行了综述、分类和总结,并介绍图像分割中常用的损失函数、评价参数和模块,进而总结了针对不同目标改进U-Net结构的思路和方法,为相关研究提供了参考.

Glaucoma Detection with Retinal Fundus Images Using Segmentation and Classification

Glaucoma is a prevalent cause of blindness worldwide.If not treated promptly,it can cause vision and quality of life to deteriorate.According to statistics,glaucoma affects approximately 65 million individuals globally.Fundus image segmentation depends on the optic disc(OD)and optic cup(OC).This paper proposes a computational model to segment and classify retinal fundus images for glaucoma detection.Different data augmentation techniques were applied to prevent overfitting while employing several data pre-processing approaches to improve the image quality and achieve high accuracy.The segmentation models are based on an attention U-Net with three separate convolutional neural networks(CNNs)backbones:Inception-v3,visual geometry group 19(VGG19),and residual neural network 50(ResNet50).The classification models also employ a modified version of the above three CNN architectures.Using the RIM-ONE dataset,the attention U-Net with the ResNet50 model as the encoder backbone,achieved the best accuracy of 99.58%in segmenting OD.The Inception-v3 model had the highest accuracy of 98.79%for glaucoma classification among the evaluated segmentation,followed by the modified classification architectures.

基于改进U-Net的全心脏CT图像分割

针对CT图像中全心脏结构复杂度高、分割不完整及分割精度低等问题,文章提出了一种改进U-Net的全心脏分割方法。根据全心脏结构形态特点,文章将多并行尺度特征融合模块引入U-Net网络的编码层,并在U-Net网络的跳层连接中加入了注意力机制。文章利用MM-WHS数据集将改进的全心脏分割算法在中南民族大学认知科学实验室中进行了一系列的全心脏分割实验。实验结果显示,文章提出的算法分割相似度达到88.73%,提高了全心脏结构的分割准确率。

基于改进U-Net的宫颈细胞核图像分割

原始的U-Net采用跳跃结构结合高低层的图像信息,使得U-Net模型有良好的分割效果,但是分割结果在宫颈细胞核边缘依然存在分割欠佳、过分割和欠分割等不足.由此提出了改进型U-Net网络图像分割方法.首先将稠密连接的DenseNet引入U-Net的编码器部分,以解决编码器部分相对简单,不能提取相对抽象的高层语义特征.然后对二元交叉熵损失函数中的宫颈细胞核和背景给予不同的权重,使网络更加注重细胞核特征的学习.最后在池化操作过程中,对池化域内的像素值分配合理的权值,解决池化层丢失信息的问题.实验证明,改进型U-Net网络使宫颈细胞核分割效果更好,模型也越鲁棒,过分割和欠分割比率也越少.显然,改进型U-Net是更有效的图像分割方法.

基于改进卷积神经网络的无人机异常飞行检测

在无人机异常飞行姿态检测过程中,受到姿态识别模型的影响,导致算法的时间复杂度较高。因此,提出了基于改进卷积神经网络的轻小型无人机异常飞行姿态检测算法。通过无人机姿态坐标的转换,获取图像采集位置。针对采集图像进行处理和分割,提高了图像特征采集精度。基于改进卷积神经网络构建识别模型,完成飞行姿态快速识别。最后,运用高斯混合模型聚类方法建立异常姿态判别规则,实现无人机异常飞行姿态检测。实验结果证明,比较两种对比方法,文中设计的检测算法分时间复杂度降低了48.27%和67.81%。

改进神经网络在激光图像分割中的应用

由于多种因素影响,激光图像结构非常复杂,传统方法难以获得高精度的分割结果,为了提高激光图像的分割精度,提出一种改进神经网络的激光图像分割方法。首先对激光图像进行去噪处理,消除噪声对图像分割的不利影响,然后采用改进神经网络对激光图像进行分割,最后采用多幅激光图像进行仿真性能测试。实验结果表明,改进神经网络以较少时间准确分割出激光图像中的目标区域,可以有效抑制噪声对分割结果的干扰,且比当前经典激光图像分割算法具有明显的伟优势。

从U-Net到Transformer:深度模型在医学图像分割中的应用综述

精准分割医学图像中的病灶对医生探寻病因和制定诊疗方案起关键作用,计算机视觉技术的发展促使深度学习在医学图像分割领域衍生出多种模型架构。U-Net架构以其巧妙的跳跃连接、易于优化的模块设计成为这一领域的基准模型。然而,U-Net以卷积神经网络(CNN)为主干,在长期建模依赖关系方面只擅长获取局部特征,基于CNN的各项方法在执行分割任务中缺乏对图像长期相关性的解释,无法提取全局特征。为帮助本领域学者了解U-Net的发展历程及研究现状,以问题为导向对2016-2023年U-Net改进工作进行综述。首先,从改进结构位置的角度对U-Net及其各项改进模型进行叙述,探讨各工作的研究目的和创新设计及不足之处;其次,对Transformer与U-Net的结合方式进行分析,从中获取改进工作的研究动向;最后,在Synapse和ACDC数据集上进行对比实验,通过实验分析和可视化结果表明,Transformer方法在分割精度方面有显著优势,特别是混合网络子块的结合方式,在确保模型性能的同时兼顾效率,证明了该类工作有着广阔的发展前景和研究价值。

一种复杂背景环境下的改进型PCNN图像分割算法

针对复杂背景环境下传统图像分割算法存在分割精度低、抗干扰性差等问题,论文提出一种改进型脉冲耦合神经网络(Improved Pulse Coupled Neural Network,IPCNN)图像分割算法。该算法综合考虑图像像元的灰度分布信息及像元之间的空间位置信息,在简化PCNN模型的基础之上,结合二维最大类间方差法对初始阈值进行优化,并且为了提高算法的实时性,推导并给出了相关快速递推公式;同时,不同于传统PCNN依据经验或通过大量实验确定模型关键参数的做法,而是从PCNN的耦合特性出发、结合图像自身空间和灰度特性,通过计算图像局部灰度均方差确定连接强度系数,并综合考虑像素点的空间与灰度值差异确定其连接权值矩阵,最后依据信息熵最大原则判别分割结果,实现了目标对象自适应自动分割。数字实验表明,该算法较传统PCNN算法具有图像分割速度快、目标轮廓分割清晰、抗干扰性强等优点。

基于改进U-Net网络的遥感影像农村道路矢量中心线提取及优化

遥感影像中农村道路矢量中心线的准确提取对乡村规划和地理信息数据库建设具有重要意义。针对现有深度学习方法未能充分利用上下文信息,且在下采样过程中易造成图像分辨率下降和局部特征丢失的问题,该文改进U-Net网络模型以提高提取结果的准确性。首先,网络结构设计两次下采样处理,并将上下文两处特征信息用跳跃层连接,使输出的道路细节清晰;其次,为避免样本不均衡导致训练效果不理想,采用交叉熵损失函数与广义骰子损失函数叠加的方式提升训练效果;最后,采用邻域质心投票算法和融合算法对提取的道路进行矢量化和中心线优化,得到高精度的农村道路矢量中心线。试验结果表明:改进方法在复杂场景的农村道路矢量中心线提取中准确率达95.03%,较4种对比算法(U-Net、DC-Net、PA-Net、SM-Net)具有明显优势。