Lupus Nephritis(LN)is a significant risk factor for morbidity and mortality in systemic lupus erythematosus,and nephropathology is still the gold standard for diagnosing LN.To assist pathologists in evaluating histopa...Lupus Nephritis(LN)is a significant risk factor for morbidity and mortality in systemic lupus erythematosus,and nephropathology is still the gold standard for diagnosing LN.To assist pathologists in evaluating histopathological images of LN,a 2D Rényi entropy multi-threshold image segmentation method is proposed in this research to apply to LN images.This method is based on an improved Cuckoo Search(CS)algorithm that introduces a Diffusion Mechanism(DM)and an Adaptiveβ-Hill Climbing(AβHC)strategy called the DMCS algorithm.The DMCS algorithm is tested on 30 benchmark functions of the IEEE CEC2017 dataset.In addition,the DMCS-based multi-threshold image segmentation method is also used to segment renal pathological images.Experimental results show that adding these two strategies improves the DMCS algorithm's ability to find the optimal solution.According to the three image quality evaluation metrics:PSNR,FSIM,and SSIM,the proposed image segmentation method performs well in image segmentation experiments.Our research shows that the DMCS algorithm is a helpful image segmentation method for renal pathological images.展开更多
Identification of the ice channel is the basic technology for developing intelligent ships in ice-covered waters,which is important to ensure the safety and economy of navigation.In the Arctic,merchant ships with low ...Identification of the ice channel is the basic technology for developing intelligent ships in ice-covered waters,which is important to ensure the safety and economy of navigation.In the Arctic,merchant ships with low ice class often navigate in channels opened up by icebreakers.Navigation in the ice channel often depends on good maneuverability skills and abundant experience from the captain to a large extent.The ship may get stuck if steered into ice fields off the channel.Under this circumstance,it is very important to study how to identify the boundary lines of ice channels with a reliable method.In this paper,a two-staged ice channel identification method is developed based on image segmentation and corner point regression.The first stage employs the image segmentation method to extract channel regions.In the second stage,an intelligent corner regression network is proposed to extract the channel boundary lines from the channel region.A non-intelligent angle-based filtering and clustering method is proposed and compared with corner point regression network.The training and evaluation of the segmentation method and corner regression network are carried out on the synthetic and real ice channel dataset.The evaluation results show that the accuracy of the method using the corner point regression network in the second stage is achieved as high as 73.33%on the synthetic ice channel dataset and 70.66%on the real ice channel dataset,and the processing speed can reach up to 14.58frames per second.展开更多
This paper presents a novel computerized technique for the segmentation of nuclei in hematoxylin and eosin(H&E)stained histopathology images.The purpose of this study is to overcome the challenges faced in automat...This paper presents a novel computerized technique for the segmentation of nuclei in hematoxylin and eosin(H&E)stained histopathology images.The purpose of this study is to overcome the challenges faced in automated nuclei segmentation due to the diversity of nuclei structures that arise from differences in tissue types and staining protocols,as well as the segmentation of variable-sized and overlapping nuclei.To this extent,the approach proposed in this study uses an ensemble of the UNet architecture with various Convolutional Neural Networks(CNN)architectures as encoder backbones,along with stain normalization and test time augmentation,to improve segmentation accuracy.Additionally,this paper employs a Structure-Preserving Color Normalization(SPCN)technique as a preprocessing step for stain normalization.The proposed model was trained and tested on both single-organ and multi-organ datasets,yielding an F1 score of 84.11%,mean Intersection over Union(IoU)of 81.67%,dice score of 84.11%,accuracy of 92.58%and precision of 83.78%on the multi-organ dataset,and an F1 score of 87.04%,mean IoU of 86.66%,dice score of 87.04%,accuracy of 96.69%and precision of 87.57%on the single-organ dataset.These findings demonstrate that the proposed model ensemble coupled with the right pre-processing and post-processing techniques enhances nuclei segmentation capabilities.展开更多
It has remained a hard nut for years to segment sonar images of jacket installation environment,most of which are noisy images with inevitable blur after noise reduction.For the purpose of solutions to this problem,a ...It has remained a hard nut for years to segment sonar images of jacket installation environment,most of which are noisy images with inevitable blur after noise reduction.For the purpose of solutions to this problem,a fast segmen-tation algorithm is proposed on the basis of the gray value characteristics of sonar images.This algorithm is endowed with the advantage in no need of segmentation thresholds.To realize this goal,we follow the undermentioned steps:first,calcu-late the gray matrix of the fuzzy image background.After adjusting the gray value,the image is divided into three regions:background region,buffer region and target regions.Afterfiltering,we reset the pixels with gray value lower than 255 to binarize images and eliminate most artifacts.Finally,the remaining noise is removed by morphological processing.The simulation results of several sonar images show that the algorithm can segment the fuzzy sonar images quickly and effectively.Thus,the stable and feasible method is testified.展开更多
The intuitive fuzzy set has found important application in decision-making and machine learning.To enrich and utilize the intuitive fuzzy set,this study designed and developed a deep neural network-based glaucoma eye ...The intuitive fuzzy set has found important application in decision-making and machine learning.To enrich and utilize the intuitive fuzzy set,this study designed and developed a deep neural network-based glaucoma eye detection using fuzzy difference equations in the domain where the retinal images converge.Retinal image detections are categorized as normal eye recognition,suspected glaucomatous eye recognition,and glaucomatous eye recognition.Fuzzy degrees associated with weighted values are calculated to determine the level of concentration between the fuzzy partition and the retinal images.The proposed model was used to diagnose glaucoma using retinal images and involved utilizing the Convolutional Neural Network(CNN)and deep learning to identify the fuzzy weighted regularization between images.This methodology was used to clarify the input images and make them adequate for the process of glaucoma detection.The objective of this study was to propose a novel approach to the early diagnosis of glaucoma using the Fuzzy Expert System(FES)and Fuzzy differential equation(FDE).The intensities of the different regions in the images and their respective peak levels were determined.Once the peak regions were identified,the recurrence relationships among those peaks were then measured.Image partitioning was done due to varying degrees of similar and dissimilar concentrations in the image.Similar and dissimilar concentration levels and spatial frequency generated a threshold image from the combined fuzzy matrix and FDE.This distinguished between a normal and abnormal eye condition,thus detecting patients with glaucomatous eyes.展开更多
Automatic segmentation of medical images provides a reliable scientific basis for disease diagnosis and analysis.Notably,most existing methods that combine the strengths of convolutional neural networks(CNNs)and Trans...Automatic segmentation of medical images provides a reliable scientific basis for disease diagnosis and analysis.Notably,most existing methods that combine the strengths of convolutional neural networks(CNNs)and Transformers have made significant progress.However,there are some limitations in the current integration of CNN and Transformer technology in two key aspects.Firstly,most methods either overlook or fail to fully incorporate the complementary nature between local and global features.Secondly,the significance of integrating the multiscale encoder features from the dual-branch network to enhance the decoding features is often disregarded in methods that combine CNN and Transformer.To address this issue,we present a groundbreaking dual-branch cross-attention fusion network(DCFNet),which efficiently combines the power of Swin Transformer and CNN to generate complementary global and local features.We then designed the Feature Cross-Fusion(FCF)module to efficiently fuse local and global features.In the FCF,the utilization of the Channel-wise Cross-fusion Transformer(CCT)serves the purpose of aggregatingmulti-scale features,and the Feature FusionModule(FFM)is employed to effectively aggregate dual-branch prominent feature regions from the spatial perspective.Furthermore,within the decoding phase of the dual-branch network,our proposed Channel Attention Block(CAB)aims to emphasize the significance of the channel features between the up-sampled features and the features generated by the FCFmodule to enhance the details of the decoding.Experimental results demonstrate that DCFNet exhibits enhanced accuracy in segmentation performance.Compared to other state-of-the-art(SOTA)methods,our segmentation framework exhibits a superior level of competitiveness.DCFNet’s accurate segmentation of medical images can greatly assist medical professionals in making crucial diagnoses of lesion areas in advance.展开更多
In this paper,we consider the Chan–Vese(C-V)model for image segmentation and obtain its numerical solution accurately and efficiently.For this purpose,we present a local radial basis function method based on a Gaussi...In this paper,we consider the Chan–Vese(C-V)model for image segmentation and obtain its numerical solution accurately and efficiently.For this purpose,we present a local radial basis function method based on a Gaussian kernel(GA-LRBF)for spatial discretization.Compared to the standard radial basis functionmethod,this approach consumes less CPU time and maintains good stability because it uses only a small subset of points in the whole computational domain.Additionally,since the Gaussian function has the property of dimensional separation,the GA-LRBF method is suitable for dealing with isotropic images.Finally,a numerical scheme that couples GA-LRBF with the fourth-order Runge–Kutta method is applied to the C-V model,and a comparison of some numerical results demonstrates that this scheme achieves much more reliable image segmentation.展开更多
Since the fully convolutional network has achieved great success in semantic segmentation,lots of works have been proposed to extract discriminative pixel representations.However,the authors observe that existing meth...Since the fully convolutional network has achieved great success in semantic segmentation,lots of works have been proposed to extract discriminative pixel representations.However,the authors observe that existing methods still suffer from two typical challenges:(i)The intra-class feature variation between different scenes may be large,leading to the difficulty in maintaining the consistency between same-class pixels from different scenes;(ii)The inter-class feature distinction in the same scene could be small,resulting in the limited performance to distinguish different classes in each scene.The authors first rethink se-mantic segmentation from a perspective of similarity between pixels and class centers.Each weight vector of the segmentation head represents its corresponding semantic class in the whole dataset,which can be regarded as the embedding of the class center.Thus,the pixel-wise classification amounts to computing similarity in the final feature space between pixels and the class centers.Under this novel view,the authors propose a Class Center Similarity(CCS)layer to address the above-mentioned challenges by generating adaptive class centers conditioned on each scenes and supervising the similarities between class centers.The CCS layer utilises the Adaptive Class Center Module to generate class centers conditioned on each scene,which adapt the large intra-class variation between different scenes.Specially designed Class Distance Loss(CD Loss)is introduced to control both inter-class and intra-class distances based on the predicted center-to-center and pixel-to-center similarity.Finally,the CCS layer outputs the processed pixel-to-center similarity as the segmentation prediction.Extensive experiments demonstrate that our model performs favourably against the state-of-the-art methods.展开更多
Magnetic resonance(MR)imaging is a widely employed medical imaging technique that produces detailed anatomical images of the human body.The segmentation of MR im-ages plays a crucial role in medical image analysis,as ...Magnetic resonance(MR)imaging is a widely employed medical imaging technique that produces detailed anatomical images of the human body.The segmentation of MR im-ages plays a crucial role in medical image analysis,as it enables accurate diagnosis,treatment planning,and monitoring of various diseases and conditions.Due to the lack of sufficient medical images,it is challenging to achieve an accurate segmentation,especially with the application of deep learning networks.The aim of this work is to study transfer learning from T1-weighted(T1-w)to T2-weighted(T2-w)MR sequences to enhance bone segmentation with minimal required computation resources.With the use of an excitation-based convolutional neural networks,four transfer learning mechanisms are proposed:transfer learning without fine tuning,open fine tuning,conservative fine tuning,and hybrid transfer learning.Moreover,a multi-parametric segmentation model is proposed using T2-w MR as an intensity-based augmentation technique.The novelty of this work emerges in the hybrid transfer learning approach that overcomes the overfitting issue and preserves the features of both modalities with minimal computation time and resources.The segmentation results are evaluated using 14 clinical 3D brain MR and CT images.The results reveal that hybrid transfer learning is superior for bone segmentation in terms of performance and computation time with DSCs of 0.5393±0.0007.Although T2-w-based augmentation has no significant impact on the performance of T1-w MR segmentation,it helps in improving T2-w MR segmentation and developing a multi-sequences segmentation model.展开更多
Currently,deep learning is widely used in medical image segmentation and has achieved good results.However,3D medical image segmentation tasks with diverse lesion characters,blurred edges,and unstable positions requir...Currently,deep learning is widely used in medical image segmentation and has achieved good results.However,3D medical image segmentation tasks with diverse lesion characters,blurred edges,and unstable positions require complex networks with a large number of parameters.It is computationally expensive and results in high requirements on equipment,making it hard to deploy the network in hospitals.In this work,we propose a method for network lightweighting and applied it to a 3D CNN based network.We experimented on a COVID-19 lesion segmentation dataset.Specifically,we use three cascaded one-dimensional convolutions to replace a 3D convolution,and integrate instance normalization with the previous layer of one-dimensional convolutions to accelerate network inference.In addition,we simplify test-time augmentation and deep supervision of the network.Experiments show that the lightweight network can reduce the prediction time of each sample and the memory usage by 50%and reduce the number of parameters by 60%compared with the original network.The training time of one epoch is also reduced by 50%with the segmentation accuracy dropped within the acceptable range.展开更多
Deep learning has been extensively applied to medical image segmentation,resulting in significant advancements in the field of deep neural networks for medical image segmentation since the notable success of U Net in ...Deep learning has been extensively applied to medical image segmentation,resulting in significant advancements in the field of deep neural networks for medical image segmentation since the notable success of U Net in 2015.However,the application of deep learning models to ocular medical image segmentation poses unique challenges,especially compared to other body parts,due to the complexity,small size,and blurriness of such images,coupled with the scarcity of data.This article aims to provide a comprehensive review of medical image segmentation from two perspectives:the development of deep network structures and the application of segmentation in ocular imaging.Initially,the article introduces an overview of medical imaging,data processing,and performance evaluation metrics.Subsequently,it analyzes recent developments in U-Net-based network structures.Finally,for the segmentation of ocular medical images,the application of deep learning is reviewed and categorized by the type of ocular tissue.展开更多
Deep convolutional neural network (CNN) greatly promotes the automatic segmentation of medical images. However, due to the inherent properties of convolution operations, CNN usually cannot establish long-distance inte...Deep convolutional neural network (CNN) greatly promotes the automatic segmentation of medical images. However, due to the inherent properties of convolution operations, CNN usually cannot establish long-distance interdependence, which limits the segmentation performance. Transformer has been successfully applied to various computer vision, using self-attention mechanism to simulate long-distance interaction, so as to capture global information. However, self-attention lacks spatial location and high-performance computing. In order to solve the above problems, we develop a new medical transformer, which has a multi-scale context fusion function and can be used for medical image segmentation. The proposed model combines convolution operation and attention mechanism to form a u-shaped framework, which can capture both local and global information. First, the traditional converter module is improved to an advanced converter module, which uses post-layer normalization to obtain mild activation values, and uses scaled cosine attention with a moving window to obtain accurate spatial information. Secondly, we also introduce a deep supervision strategy to guide the model to fuse multi-scale feature information. It further enables the proposed model to effectively propagate feature information across layers, Thanks to this, it can achieve better segmentation performance while being more robust and efficient. The proposed model is evaluated on multiple medical image segmentation datasets. Experimental results demonstrate that the proposed model achieves better performance on a challenging dataset (ETIS) compared to existing methods that rely only on convolutional neural networks, transformers, or a combination of both. The mDice and mIou indicators increased by 2.74% and 3.3% respectively.展开更多
Segmenting the lesion regions from the ultrasound (US) images is an important step in the intra-operative planning of some computer-aided therapies. High-Intensity Focused Ultrasound (HIFU), as a popular computer-...Segmenting the lesion regions from the ultrasound (US) images is an important step in the intra-operative planning of some computer-aided therapies. High-Intensity Focused Ultrasound (HIFU), as a popular computer-aided therapy, has been widely used in the treatment of uterine fibroids. However, such segmentation in HIFU remains challenge for two reasons: (1) the blurry or missing boundaries of lesion regions in the HIFU images and (2) the deformation of uterine fibroids caused by the patient's breathing or an external force during the US imaging process, which can lead to complex shapes of lesion regions. These factors have prevented classical active contour-based segmentation methods from yielding desired results for uterine fibroids in US images. In this paper, a novel active contour-based segmentation method is proposed, which utilizes the correlation information of target shapes among a sequence of images as prior knowledge to aid the existing active contour method. This prior knowledge can be interpreted as a unsupervised clustering of shapes prior modeling. Meanwhile, it is also proved that the shapes correlation has the low-rank property in a linear space, and the theory of matrix recovery is used as an effective tool to impose the proposed prior on an existing active contour model. Finally, an accurate method is developed to solve the proposed model by using the Augmented Lagrange Multiplier (ALM). Experimental results from both synthetic and clinical uterine fibroids US image sequences demonstrate that the proposed method can consistently improve the performance of active contour models and increase the robustness against missing or misleading boundaries, and can greatly improve the efficiency of HIFU therapy.展开更多
Lots of noises and heterogeneous objects with various sizes coexist in a complex image,such as an ore image;the classical image thresholding method cannot effectively distinguish between ores.To segment ore objects wi...Lots of noises and heterogeneous objects with various sizes coexist in a complex image,such as an ore image;the classical image thresholding method cannot effectively distinguish between ores.To segment ore objects with various sizes simultaneously,two adaptive windows in the image were chosen for each pixel;the gray value of windows was calculated by Otsu's threshold method.To extract the object skeleton,the definition principle of distance transformation templates was proposed.The ores linked together in a binary image were separated by distance transformation and gray reconstruction.The seed region of each object was picked up from the local maximum gray region of the reconstruction image.Starting from these seed regions,the watershed method was used to segment ore object effectively.The proposed algorithm marks and segments most objects from complex images precisely.展开更多
In this study,a novel hybrid Water Cycle Moth-Flame Optimization(WCMFO)algorithm is proposed for multilevel thresholding brain image segmentation in Magnetic Resonance(MR)image slices.WCMFO constitutes a hybrid betwee...In this study,a novel hybrid Water Cycle Moth-Flame Optimization(WCMFO)algorithm is proposed for multilevel thresholding brain image segmentation in Magnetic Resonance(MR)image slices.WCMFO constitutes a hybrid between the two techniques,comprising the water cycle and moth-flame optimization algorithms.The optimal thresholds are obtained by maximizing the between class variance(Otsu’s function)of the image.To test the performance of threshold searching process,the proposed algorithm has been evaluated on standard benchmark of ten axial T2-weighted brain MR images for image segmentation.The experimental outcomes infer that it produces better optimal threshold values at a greater and quicker convergence rate.In contrast to other state-of-the-art methods,namely Adaptive Wind Driven Optimization(AWDO),Adaptive Bacterial Foraging(ABF)and Particle Swarm Optimization(PSO),the proposed algorithm has been found to be better at producing the best objective function,Peak Signal-to-Noise Ratio(PSNR),Standard Deviation(STD)and lower computational time values.Further,it was observed thatthe segmented image gives greater detail when the threshold level increases.Moreover,the statistical test result confirms that the best and mean values are almost zero and the average difference between best and mean value 1.86 is obtained through the 30 executions of the proposed algorithm.Thus,these images will lead to better segments of gray,white and cerebrospinal fluid that enable better clinical choices and diagnoses using a proposed algorithm.展开更多
Magnetic resonance imaging(MRI)has been a prevalence technique for breast cancer diagnosis.Computer-aided detection and segmentation of lesions from MRIs plays a vital role for the MRI-based disease analysis.There are...Magnetic resonance imaging(MRI)has been a prevalence technique for breast cancer diagnosis.Computer-aided detection and segmentation of lesions from MRIs plays a vital role for the MRI-based disease analysis.There are two main issues of the existing breast lesion segmentation techniques:requir ing manual delineation of Regions of Interests(ROIs)as a step of initialization;and requiring a large amount of labeled images for model construction or parameter lear ning,while in real clinical or experimental settings,it is highly challenging to get suficient labeled MRIs.To resolve these issues,this work proposes a semi-supervised method for breast tumor segmentation based on super voxel strategies.After image segmentation with advanced cluster techniques,we take a supervised learning step to classify the tumor and nontumor patches in order to automatically locate the tumor regions in an MRI To obtain the opt imal performance of tumor extraction,we take extensive experiments to learn par ameters for tumor segmentation and dassification,and design 225 classifiers corresponding to diferent parameter settings.We call the proposed method as Semi supervised Tumor Segmentation(SSTS),and apply it to both mass and nonmass lesions.Experimental results show better performance of SsTS compared with five state of-the art methods.展开更多
Segmentation is the key step in auto-interpretation of high-resolution spaceborne synthetic aperture radar(SAR) images. A novel method is proposed based on integrating the geometric active contour(GAC) and the sup...Segmentation is the key step in auto-interpretation of high-resolution spaceborne synthetic aperture radar(SAR) images. A novel method is proposed based on integrating the geometric active contour(GAC) and the support vector machine(SVM)models. First, the images are segmented by using SVM and textural statistics. A likelihood measurement for every pixel is derived by using the initial segmentation. The Chan-Vese model then is modified by adding two items: the likelihood and the distance between the initial segmentation and the evolving contour. Experimental results using real SAR images demonstrate the good performance of the proposed method compared to several classic GAC models.展开更多
Leukaemia is a type of blood cancer that is caused by undeveloped White Blood Cells(WBC),and it is also called a blast blood cell.In the marrow of human bones,leukaemia is developed and is responsible for blood cell g...Leukaemia is a type of blood cancer that is caused by undeveloped White Blood Cells(WBC),and it is also called a blast blood cell.In the marrow of human bones,leukaemia is developed and is responsible for blood cell generation with leukocytes and WBC,and if any cell gets blasted,then it may become a cause of death.Therefore,the diagnosis of leukaemia in its early stages helps greatly in the treatment along with saving human lives.Subsequently,in terms of detection,image segmentation techniques play a vital role,and they turn out to be the important image processing steps for the extraction of feature patterns from the Acute Lymphoblastic Leukaemia(ALL)type of blood cancer.Moreover,the image segmentation technique focuses on the division of cells by segmenting a microscopic image into background and cancer blood cell nucleus,which is well-known as the Region Of Interest(ROI).As a result,in this article,we attempt to build a segmentation technique capable of solving blood cell nucleus segmentation issues using four distinct scenarios,including K-means,FCM(Fuzzy Cmeans),K-means with FFA(Firefly Algorithm),and FCM with FFA.Also,we determine the most effective method of blood cell nucleus segmentation,which we subsequently use for the Leukaemia classification model.Finally,using the Convolution Neural Network(CNN)as a classifier,we developed a leukaemia cancer classification model from the microscopic images.The proposed system’s classification accuracy is tested using the CNN to test the model on the ALL-IDB dataset and equate it to the current state of the art.In terms of experimental analysis,we observed that the accuracy of the model is near to 99%,and it is far better than other existing models that are designed to segment and classify the types of leukaemia cancer in terms of ALL.展开更多
A leukocyte segmentation method based on S component and B component images is proposed.Threshold segmentation operation is applied to get two binary images in S component and B component images.The samples used in th...A leukocyte segmentation method based on S component and B component images is proposed.Threshold segmentation operation is applied to get two binary images in S component and B component images.The samples used in this study are peripheral blood smears.It is easy tofind from the two binary images that gray values are the same at every corresponding pixels in theleukocyte cytoplasm region,but opposite in the other regions.The feature shows that "IMAGEAND"operation can be employed on the two binary images to segment the cytoplasm region ofleukocyte.By doing"IMAGE XOR"operation between cytoplasn region and nucleus region,theleukocyte segment ation can be retrieved effectively.The segmentation accuracy is evaluated by comparing the segmentation result of the proposed method with the manual segmentation by ahematologist.Experiment results show that the proposed method is of a higher segmentationaccuracy and it also performs well when leukocytes overlap_with erythrocytes.The averagesegmentation accuracy of the proposed method reaches 97.7%for segmenting five types ofleukocyte.Good segmentation results provide an important foundation for leukocytes aut omaticrecognition.展开更多
Aiming at the problem that the existence of disturbances on the edges of light-stripe makes the segmentation of the light-stripes images difficult, a new segmentation algorithm based on edge-searching is presented. It...Aiming at the problem that the existence of disturbances on the edges of light-stripe makes the segmentation of the light-stripes images difficult, a new segmentation algorithm based on edge-searching is presented. It firstly calculates every edge pixel's horizontal coordinate grads to produce the corresponding grads-edge, then uses a designed length-variable l D template to scan the light-stripes' grads-edges. The template is able to find the disturbances with different width utilizing the distributing character of the edge disturbances. The found disturbances are eliminated finally. The algorithm not only can smoothly segment the light-stripes images, but also eliminate most disturbances on the light-stripes' edges without damaging the light-stripes images' 3D information. A practical example of using the proposed algorithm is given in the end. It is proved that the efficiency of the algorithm has been improved obviously by comparison.展开更多
基金supported in part by the Natural Science Foundation of Zhejiang Province(LZ22F020005,LTGS23E070001)National Natural Science Foundation of China(62076185,U1809209).
文摘Lupus Nephritis(LN)is a significant risk factor for morbidity and mortality in systemic lupus erythematosus,and nephropathology is still the gold standard for diagnosing LN.To assist pathologists in evaluating histopathological images of LN,a 2D Rényi entropy multi-threshold image segmentation method is proposed in this research to apply to LN images.This method is based on an improved Cuckoo Search(CS)algorithm that introduces a Diffusion Mechanism(DM)and an Adaptiveβ-Hill Climbing(AβHC)strategy called the DMCS algorithm.The DMCS algorithm is tested on 30 benchmark functions of the IEEE CEC2017 dataset.In addition,the DMCS-based multi-threshold image segmentation method is also used to segment renal pathological images.Experimental results show that adding these two strategies improves the DMCS algorithm's ability to find the optimal solution.According to the three image quality evaluation metrics:PSNR,FSIM,and SSIM,the proposed image segmentation method performs well in image segmentation experiments.Our research shows that the DMCS algorithm is a helpful image segmentation method for renal pathological images.
基金financially supported by the National Key Research and Development Program(Grant No.2022YFE0107000)the General Projects of the National Natural Science Foundation of China(Grant No.52171259)the High-Tech Ship Research Project of the Ministry of Industry and Information Technology(Grant No.[2021]342)。
文摘Identification of the ice channel is the basic technology for developing intelligent ships in ice-covered waters,which is important to ensure the safety and economy of navigation.In the Arctic,merchant ships with low ice class often navigate in channels opened up by icebreakers.Navigation in the ice channel often depends on good maneuverability skills and abundant experience from the captain to a large extent.The ship may get stuck if steered into ice fields off the channel.Under this circumstance,it is very important to study how to identify the boundary lines of ice channels with a reliable method.In this paper,a two-staged ice channel identification method is developed based on image segmentation and corner point regression.The first stage employs the image segmentation method to extract channel regions.In the second stage,an intelligent corner regression network is proposed to extract the channel boundary lines from the channel region.A non-intelligent angle-based filtering and clustering method is proposed and compared with corner point regression network.The training and evaluation of the segmentation method and corner regression network are carried out on the synthetic and real ice channel dataset.The evaluation results show that the accuracy of the method using the corner point regression network in the second stage is achieved as high as 73.33%on the synthetic ice channel dataset and 70.66%on the real ice channel dataset,and the processing speed can reach up to 14.58frames per second.
文摘This paper presents a novel computerized technique for the segmentation of nuclei in hematoxylin and eosin(H&E)stained histopathology images.The purpose of this study is to overcome the challenges faced in automated nuclei segmentation due to the diversity of nuclei structures that arise from differences in tissue types and staining protocols,as well as the segmentation of variable-sized and overlapping nuclei.To this extent,the approach proposed in this study uses an ensemble of the UNet architecture with various Convolutional Neural Networks(CNN)architectures as encoder backbones,along with stain normalization and test time augmentation,to improve segmentation accuracy.Additionally,this paper employs a Structure-Preserving Color Normalization(SPCN)technique as a preprocessing step for stain normalization.The proposed model was trained and tested on both single-organ and multi-organ datasets,yielding an F1 score of 84.11%,mean Intersection over Union(IoU)of 81.67%,dice score of 84.11%,accuracy of 92.58%and precision of 83.78%on the multi-organ dataset,and an F1 score of 87.04%,mean IoU of 86.66%,dice score of 87.04%,accuracy of 96.69%and precision of 87.57%on the single-organ dataset.These findings demonstrate that the proposed model ensemble coupled with the right pre-processing and post-processing techniques enhances nuclei segmentation capabilities.
基金supported by Open Fund Project of China Key Laboratory of Submarine Geoscience(KLSG1802)Science&Technology Project of China Ocean Mineral Resources Research and Development Association(DY135-N1-1-05)Science&Technology Project of Zhoushan city of Zhejiang Province(2019C42271,2019C33205).
文摘It has remained a hard nut for years to segment sonar images of jacket installation environment,most of which are noisy images with inevitable blur after noise reduction.For the purpose of solutions to this problem,a fast segmen-tation algorithm is proposed on the basis of the gray value characteristics of sonar images.This algorithm is endowed with the advantage in no need of segmentation thresholds.To realize this goal,we follow the undermentioned steps:first,calcu-late the gray matrix of the fuzzy image background.After adjusting the gray value,the image is divided into three regions:background region,buffer region and target regions.Afterfiltering,we reset the pixels with gray value lower than 255 to binarize images and eliminate most artifacts.Finally,the remaining noise is removed by morphological processing.The simulation results of several sonar images show that the algorithm can segment the fuzzy sonar images quickly and effectively.Thus,the stable and feasible method is testified.
基金funding the publication of this research through the Researchers Supporting Program (RSPD2023R809),King Saud University,Riyadh,Saudi Arabia.
文摘The intuitive fuzzy set has found important application in decision-making and machine learning.To enrich and utilize the intuitive fuzzy set,this study designed and developed a deep neural network-based glaucoma eye detection using fuzzy difference equations in the domain where the retinal images converge.Retinal image detections are categorized as normal eye recognition,suspected glaucomatous eye recognition,and glaucomatous eye recognition.Fuzzy degrees associated with weighted values are calculated to determine the level of concentration between the fuzzy partition and the retinal images.The proposed model was used to diagnose glaucoma using retinal images and involved utilizing the Convolutional Neural Network(CNN)and deep learning to identify the fuzzy weighted regularization between images.This methodology was used to clarify the input images and make them adequate for the process of glaucoma detection.The objective of this study was to propose a novel approach to the early diagnosis of glaucoma using the Fuzzy Expert System(FES)and Fuzzy differential equation(FDE).The intensities of the different regions in the images and their respective peak levels were determined.Once the peak regions were identified,the recurrence relationships among those peaks were then measured.Image partitioning was done due to varying degrees of similar and dissimilar concentrations in the image.Similar and dissimilar concentration levels and spatial frequency generated a threshold image from the combined fuzzy matrix and FDE.This distinguished between a normal and abnormal eye condition,thus detecting patients with glaucomatous eyes.
基金supported by the National Key R&D Program of China(2018AAA0102100)the National Natural Science Foundation of China(No.62376287)+3 种基金the International Science and Technology Innovation Joint Base of Machine Vision and Medical Image Processing in Hunan Province(2021CB1013)the Key Research and Development Program of Hunan Province(2022SK2054)the Natural Science Foundation of Hunan Province(No.2022JJ30762,2023JJ70016)the 111 Project under Grant(No.B18059).
文摘Automatic segmentation of medical images provides a reliable scientific basis for disease diagnosis and analysis.Notably,most existing methods that combine the strengths of convolutional neural networks(CNNs)and Transformers have made significant progress.However,there are some limitations in the current integration of CNN and Transformer technology in two key aspects.Firstly,most methods either overlook or fail to fully incorporate the complementary nature between local and global features.Secondly,the significance of integrating the multiscale encoder features from the dual-branch network to enhance the decoding features is often disregarded in methods that combine CNN and Transformer.To address this issue,we present a groundbreaking dual-branch cross-attention fusion network(DCFNet),which efficiently combines the power of Swin Transformer and CNN to generate complementary global and local features.We then designed the Feature Cross-Fusion(FCF)module to efficiently fuse local and global features.In the FCF,the utilization of the Channel-wise Cross-fusion Transformer(CCT)serves the purpose of aggregatingmulti-scale features,and the Feature FusionModule(FFM)is employed to effectively aggregate dual-branch prominent feature regions from the spatial perspective.Furthermore,within the decoding phase of the dual-branch network,our proposed Channel Attention Block(CAB)aims to emphasize the significance of the channel features between the up-sampled features and the features generated by the FCFmodule to enhance the details of the decoding.Experimental results demonstrate that DCFNet exhibits enhanced accuracy in segmentation performance.Compared to other state-of-the-art(SOTA)methods,our segmentation framework exhibits a superior level of competitiveness.DCFNet’s accurate segmentation of medical images can greatly assist medical professionals in making crucial diagnoses of lesion areas in advance.
基金sponsored by Guangdong Basic and Applied Basic Research Foundation under Grant No.2021A1515110680Guangzhou Basic and Applied Basic Research under Grant No.202102020340.
文摘In this paper,we consider the Chan–Vese(C-V)model for image segmentation and obtain its numerical solution accurately and efficiently.For this purpose,we present a local radial basis function method based on a Gaussian kernel(GA-LRBF)for spatial discretization.Compared to the standard radial basis functionmethod,this approach consumes less CPU time and maintains good stability because it uses only a small subset of points in the whole computational domain.Additionally,since the Gaussian function has the property of dimensional separation,the GA-LRBF method is suitable for dealing with isotropic images.Finally,a numerical scheme that couples GA-LRBF with the fourth-order Runge–Kutta method is applied to the C-V model,and a comparison of some numerical results demonstrates that this scheme achieves much more reliable image segmentation.
基金Hubei Provincial Natural Science Foundation of China,Grant/Award Number:2022CFA055National Natural Science Foundation of China,Grant/Award Number:62176097。
文摘Since the fully convolutional network has achieved great success in semantic segmentation,lots of works have been proposed to extract discriminative pixel representations.However,the authors observe that existing methods still suffer from two typical challenges:(i)The intra-class feature variation between different scenes may be large,leading to the difficulty in maintaining the consistency between same-class pixels from different scenes;(ii)The inter-class feature distinction in the same scene could be small,resulting in the limited performance to distinguish different classes in each scene.The authors first rethink se-mantic segmentation from a perspective of similarity between pixels and class centers.Each weight vector of the segmentation head represents its corresponding semantic class in the whole dataset,which can be regarded as the embedding of the class center.Thus,the pixel-wise classification amounts to computing similarity in the final feature space between pixels and the class centers.Under this novel view,the authors propose a Class Center Similarity(CCS)layer to address the above-mentioned challenges by generating adaptive class centers conditioned on each scenes and supervising the similarities between class centers.The CCS layer utilises the Adaptive Class Center Module to generate class centers conditioned on each scene,which adapt the large intra-class variation between different scenes.Specially designed Class Distance Loss(CD Loss)is introduced to control both inter-class and intra-class distances based on the predicted center-to-center and pixel-to-center similarity.Finally,the CCS layer outputs the processed pixel-to-center similarity as the segmentation prediction.Extensive experiments demonstrate that our model performs favourably against the state-of-the-art methods.
基金Swiss National Science Foundation,Grant/Award Number:SNSF 320030_176052Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung,Grant/Award Number:320030_176052。
文摘Magnetic resonance(MR)imaging is a widely employed medical imaging technique that produces detailed anatomical images of the human body.The segmentation of MR im-ages plays a crucial role in medical image analysis,as it enables accurate diagnosis,treatment planning,and monitoring of various diseases and conditions.Due to the lack of sufficient medical images,it is challenging to achieve an accurate segmentation,especially with the application of deep learning networks.The aim of this work is to study transfer learning from T1-weighted(T1-w)to T2-weighted(T2-w)MR sequences to enhance bone segmentation with minimal required computation resources.With the use of an excitation-based convolutional neural networks,four transfer learning mechanisms are proposed:transfer learning without fine tuning,open fine tuning,conservative fine tuning,and hybrid transfer learning.Moreover,a multi-parametric segmentation model is proposed using T2-w MR as an intensity-based augmentation technique.The novelty of this work emerges in the hybrid transfer learning approach that overcomes the overfitting issue and preserves the features of both modalities with minimal computation time and resources.The segmentation results are evaluated using 14 clinical 3D brain MR and CT images.The results reveal that hybrid transfer learning is superior for bone segmentation in terms of performance and computation time with DSCs of 0.5393±0.0007.Although T2-w-based augmentation has no significant impact on the performance of T1-w MR segmentation,it helps in improving T2-w MR segmentation and developing a multi-sequences segmentation model.
文摘Currently,deep learning is widely used in medical image segmentation and has achieved good results.However,3D medical image segmentation tasks with diverse lesion characters,blurred edges,and unstable positions require complex networks with a large number of parameters.It is computationally expensive and results in high requirements on equipment,making it hard to deploy the network in hospitals.In this work,we propose a method for network lightweighting and applied it to a 3D CNN based network.We experimented on a COVID-19 lesion segmentation dataset.Specifically,we use three cascaded one-dimensional convolutions to replace a 3D convolution,and integrate instance normalization with the previous layer of one-dimensional convolutions to accelerate network inference.In addition,we simplify test-time augmentation and deep supervision of the network.Experiments show that the lightweight network can reduce the prediction time of each sample and the memory usage by 50%and reduce the number of parameters by 60%compared with the original network.The training time of one epoch is also reduced by 50%with the segmentation accuracy dropped within the acceptable range.
文摘Deep learning has been extensively applied to medical image segmentation,resulting in significant advancements in the field of deep neural networks for medical image segmentation since the notable success of U Net in 2015.However,the application of deep learning models to ocular medical image segmentation poses unique challenges,especially compared to other body parts,due to the complexity,small size,and blurriness of such images,coupled with the scarcity of data.This article aims to provide a comprehensive review of medical image segmentation from two perspectives:the development of deep network structures and the application of segmentation in ocular imaging.Initially,the article introduces an overview of medical imaging,data processing,and performance evaluation metrics.Subsequently,it analyzes recent developments in U-Net-based network structures.Finally,for the segmentation of ocular medical images,the application of deep learning is reviewed and categorized by the type of ocular tissue.
文摘Deep convolutional neural network (CNN) greatly promotes the automatic segmentation of medical images. However, due to the inherent properties of convolution operations, CNN usually cannot establish long-distance interdependence, which limits the segmentation performance. Transformer has been successfully applied to various computer vision, using self-attention mechanism to simulate long-distance interaction, so as to capture global information. However, self-attention lacks spatial location and high-performance computing. In order to solve the above problems, we develop a new medical transformer, which has a multi-scale context fusion function and can be used for medical image segmentation. The proposed model combines convolution operation and attention mechanism to form a u-shaped framework, which can capture both local and global information. First, the traditional converter module is improved to an advanced converter module, which uses post-layer normalization to obtain mild activation values, and uses scaled cosine attention with a moving window to obtain accurate spatial information. Secondly, we also introduce a deep supervision strategy to guide the model to fuse multi-scale feature information. It further enables the proposed model to effectively propagate feature information across layers, Thanks to this, it can achieve better segmentation performance while being more robust and efficient. The proposed model is evaluated on multiple medical image segmentation datasets. Experimental results demonstrate that the proposed model achieves better performance on a challenging dataset (ETIS) compared to existing methods that rely only on convolutional neural networks, transformers, or a combination of both. The mDice and mIou indicators increased by 2.74% and 3.3% respectively.
基金Supported by the National Basic Research Program of China(2011CB707904)the Natural Science Foundation of China(61472289)Hubei Province Natural Science Foundation of China(2015CFB254)
文摘Segmenting the lesion regions from the ultrasound (US) images is an important step in the intra-operative planning of some computer-aided therapies. High-Intensity Focused Ultrasound (HIFU), as a popular computer-aided therapy, has been widely used in the treatment of uterine fibroids. However, such segmentation in HIFU remains challenge for two reasons: (1) the blurry or missing boundaries of lesion regions in the HIFU images and (2) the deformation of uterine fibroids caused by the patient's breathing or an external force during the US imaging process, which can lead to complex shapes of lesion regions. These factors have prevented classical active contour-based segmentation methods from yielding desired results for uterine fibroids in US images. In this paper, a novel active contour-based segmentation method is proposed, which utilizes the correlation information of target shapes among a sequence of images as prior knowledge to aid the existing active contour method. This prior knowledge can be interpreted as a unsupervised clustering of shapes prior modeling. Meanwhile, it is also proved that the shapes correlation has the low-rank property in a linear space, and the theory of matrix recovery is used as an effective tool to impose the proposed prior on an existing active contour model. Finally, an accurate method is developed to solve the proposed model by using the Augmented Lagrange Multiplier (ALM). Experimental results from both synthetic and clinical uterine fibroids US image sequences demonstrate that the proposed method can consistently improve the performance of active contour models and increase the robustness against missing or misleading boundaries, and can greatly improve the efficiency of HIFU therapy.
基金supported by the National Key Technologies R & D Program of China (No.2009BAB48B02)the National High-Tech Research and Development Program of China (Nos.2010AA060278600 and 2008AA062101)
文摘Lots of noises and heterogeneous objects with various sizes coexist in a complex image,such as an ore image;the classical image thresholding method cannot effectively distinguish between ores.To segment ore objects with various sizes simultaneously,two adaptive windows in the image were chosen for each pixel;the gray value of windows was calculated by Otsu's threshold method.To extract the object skeleton,the definition principle of distance transformation templates was proposed.The ores linked together in a binary image were separated by distance transformation and gray reconstruction.The seed region of each object was picked up from the local maximum gray region of the reconstruction image.Starting from these seed regions,the watershed method was used to segment ore object effectively.The proposed algorithm marks and segments most objects from complex images precisely.
文摘In this study,a novel hybrid Water Cycle Moth-Flame Optimization(WCMFO)algorithm is proposed for multilevel thresholding brain image segmentation in Magnetic Resonance(MR)image slices.WCMFO constitutes a hybrid between the two techniques,comprising the water cycle and moth-flame optimization algorithms.The optimal thresholds are obtained by maximizing the between class variance(Otsu’s function)of the image.To test the performance of threshold searching process,the proposed algorithm has been evaluated on standard benchmark of ten axial T2-weighted brain MR images for image segmentation.The experimental outcomes infer that it produces better optimal threshold values at a greater and quicker convergence rate.In contrast to other state-of-the-art methods,namely Adaptive Wind Driven Optimization(AWDO),Adaptive Bacterial Foraging(ABF)and Particle Swarm Optimization(PSO),the proposed algorithm has been found to be better at producing the best objective function,Peak Signal-to-Noise Ratio(PSNR),Standard Deviation(STD)and lower computational time values.Further,it was observed thatthe segmented image gives greater detail when the threshold level increases.Moreover,the statistical test result confirms that the best and mean values are almost zero and the average difference between best and mean value 1.86 is obtained through the 30 executions of the proposed algorithm.Thus,these images will lead to better segments of gray,white and cerebrospinal fluid that enable better clinical choices and diagnoses using a proposed algorithm.
基金the National Natural Science Foundation of China(Grants No 61702274)the Natural Science Foundation of Jiangsu Province(Grants No BK20170958).
文摘Magnetic resonance imaging(MRI)has been a prevalence technique for breast cancer diagnosis.Computer-aided detection and segmentation of lesions from MRIs plays a vital role for the MRI-based disease analysis.There are two main issues of the existing breast lesion segmentation techniques:requir ing manual delineation of Regions of Interests(ROIs)as a step of initialization;and requiring a large amount of labeled images for model construction or parameter lear ning,while in real clinical or experimental settings,it is highly challenging to get suficient labeled MRIs.To resolve these issues,this work proposes a semi-supervised method for breast tumor segmentation based on super voxel strategies.After image segmentation with advanced cluster techniques,we take a supervised learning step to classify the tumor and nontumor patches in order to automatically locate the tumor regions in an MRI To obtain the opt imal performance of tumor extraction,we take extensive experiments to learn par ameters for tumor segmentation and dassification,and design 225 classifiers corresponding to diferent parameter settings.We call the proposed method as Semi supervised Tumor Segmentation(SSTS),and apply it to both mass and nonmass lesions.Experimental results show better performance of SsTS compared with five state of-the art methods.
基金supported by the National Natural Science Foundation of China(4117132741301361)+2 种基金the National Key Basic Research Program of China(973 Program)(2012CB719903)the Science and Technology Project of Ministry of Transport of People’s Republic of China(2012-364-X11-803)the Shanghai Municipal Natural Science Foundation(12ZR1433200)
文摘Segmentation is the key step in auto-interpretation of high-resolution spaceborne synthetic aperture radar(SAR) images. A novel method is proposed based on integrating the geometric active contour(GAC) and the support vector machine(SVM)models. First, the images are segmented by using SVM and textural statistics. A likelihood measurement for every pixel is derived by using the initial segmentation. The Chan-Vese model then is modified by adding two items: the likelihood and the distance between the initial segmentation and the evolving contour. Experimental results using real SAR images demonstrate the good performance of the proposed method compared to several classic GAC models.
基金We deeply acknowledge Taif University for supporting this study through Taif University Researchers Supporting Project number(TURSP-2020/115),Taif University,Taif,Saudi Arabia.
文摘Leukaemia is a type of blood cancer that is caused by undeveloped White Blood Cells(WBC),and it is also called a blast blood cell.In the marrow of human bones,leukaemia is developed and is responsible for blood cell generation with leukocytes and WBC,and if any cell gets blasted,then it may become a cause of death.Therefore,the diagnosis of leukaemia in its early stages helps greatly in the treatment along with saving human lives.Subsequently,in terms of detection,image segmentation techniques play a vital role,and they turn out to be the important image processing steps for the extraction of feature patterns from the Acute Lymphoblastic Leukaemia(ALL)type of blood cancer.Moreover,the image segmentation technique focuses on the division of cells by segmenting a microscopic image into background and cancer blood cell nucleus,which is well-known as the Region Of Interest(ROI).As a result,in this article,we attempt to build a segmentation technique capable of solving blood cell nucleus segmentation issues using four distinct scenarios,including K-means,FCM(Fuzzy Cmeans),K-means with FFA(Firefly Algorithm),and FCM with FFA.Also,we determine the most effective method of blood cell nucleus segmentation,which we subsequently use for the Leukaemia classification model.Finally,using the Convolution Neural Network(CNN)as a classifier,we developed a leukaemia cancer classification model from the microscopic images.The proposed system’s classification accuracy is tested using the CNN to test the model on the ALL-IDB dataset and equate it to the current state of the art.In terms of experimental analysis,we observed that the accuracy of the model is near to 99%,and it is far better than other existing models that are designed to segment and classify the types of leukaemia cancer in terms of ALL.
文摘A leukocyte segmentation method based on S component and B component images is proposed.Threshold segmentation operation is applied to get two binary images in S component and B component images.The samples used in this study are peripheral blood smears.It is easy tofind from the two binary images that gray values are the same at every corresponding pixels in theleukocyte cytoplasm region,but opposite in the other regions.The feature shows that "IMAGEAND"operation can be employed on the two binary images to segment the cytoplasm region ofleukocyte.By doing"IMAGE XOR"operation between cytoplasn region and nucleus region,theleukocyte segment ation can be retrieved effectively.The segmentation accuracy is evaluated by comparing the segmentation result of the proposed method with the manual segmentation by ahematologist.Experiment results show that the proposed method is of a higher segmentationaccuracy and it also performs well when leukocytes overlap_with erythrocytes.The averagesegmentation accuracy of the proposed method reaches 97.7%for segmenting five types ofleukocyte.Good segmentation results provide an important foundation for leukocytes aut omaticrecognition.
基金This project is supported by National Natural Science Foundation of China (No.50275120, No.50535030)Great Science and Technology Project of Xi'an City, China(No.CX200206)
文摘Aiming at the problem that the existence of disturbances on the edges of light-stripe makes the segmentation of the light-stripes images difficult, a new segmentation algorithm based on edge-searching is presented. It firstly calculates every edge pixel's horizontal coordinate grads to produce the corresponding grads-edge, then uses a designed length-variable l D template to scan the light-stripes' grads-edges. The template is able to find the disturbances with different width utilizing the distributing character of the edge disturbances. The found disturbances are eliminated finally. The algorithm not only can smoothly segment the light-stripes images, but also eliminate most disturbances on the light-stripes' edges without damaging the light-stripes images' 3D information. A practical example of using the proposed algorithm is given in the end. It is proved that the efficiency of the algorithm has been improved obviously by comparison.