ED-Ged:Nighttime Image Semantic Segmentation Based on Enhanced Detail and Bidirectional Guidance

Semantic segmentation of driving scene images is crucial for autonomous driving.While deep learning technology has significantly improved daytime image semantic segmentation,nighttime images pose challenges due to factors like poor lighting and overexposure,making it difficult to recognize small objects.To address this,we propose an Image Adaptive Enhancement(IAEN)module comprising a parameter predictor(Edip),multiple image processing filters(Mdif),and a Detail Processing Module(DPM).Edip combines image processing filters to predict parameters like exposure and hue,optimizing image quality.We adopt a novel image encoder to enhance parameter prediction accuracy by enabling Edip to handle features at different scales.DPM strengthens overlooked image details,extending the IAEN module’s functionality.After the segmentation network,we integrate a Depth Guided Filter(DGF)to refine segmentation outputs.The entire network is trained end-to-end,with segmentation results guiding parameter prediction optimization,promoting self-learning and network improvement.This lightweight and efficient network architecture is particularly suitable for addressing challenges in nighttime image segmentation.Extensive experiments validate significant performance improvements of our approach on the ACDC-night and Nightcity datasets.

UDT:U-shaped deformable transformer for subarachnoid haemorrhage image segmentation

Subarachnoid haemorrhage(SAH),mostly caused by the rupture of intracranial aneu-rysm,is a common disease with a high fatality rate.SAH lesions are generally diffusely distributed,showing a variety of scales with irregular edges.The complex characteristics of lesions make SAH segmentation a challenging task.To cope with these difficulties,a u-shaped deformable transformer(UDT)is proposed for SAH segmentation.Specifically,first,a multi-scale deformable attention(MSDA)module is exploited to model the diffuseness and scale-variant characteristics of SAH lesions,where the MSDA module can fuse features in different scales and adjust the attention field of each element dynamically to generate discriminative multi-scale features.Second,the cross deformable attention-based skip connection(CDASC)module is designed to model the irregular edge char-acteristic of SAH lesions,where the CDASC module can utilise the spatial details from encoder features to refine the spatial information of decoder features.Third,the MSDA and CDASC modules are embedded into the backbone Res-UNet to construct the proposed UDT.Extensive experiments are conducted on the self-built SAH-CT dataset and two public medical datasets(GlaS and MoNuSeg).Experimental results show that the presented UDT achieves the state-of-the-art performance.

OBJECTIVE IMAGE QUALITY MEASURES AND THEIR APPLICATIONS IN SEGMENTATION EVALUATION

Image segmentation is a critical step of image analysis. Segmentation evaluation is an effective procedure for studying the performance of segmentation techniques, in which quality measure plays an important role. This paper presents a group of new objective quality measures for segmentation evaluation and compares their performances. In addition, to verify the effectiveness of these new measures, an appropriate classification of segmentation is proposed. According to this classification, several representative algorithms from different categories are selected for comparison testing. Some valuable results are obtained and presented.

Analysis of the Relevance of Evaluation Criteria for Multicomponent Image Segmentation

Image segmentation is an important stage in many applications such as image, video and computer processing. Generally image interpretation depends on it. The materials and methods used to demonstrate are described. The results are presented and analyzed. Several approaches and algorithms for image segmentation have been developed, but it is difficult to evaluate the efficiency and to make an objective comparison of different segmentation methods. This general problem has been addressed for the evaluation of a segmentation result and the results are available in the literature. In this work, we first presented some criteria of evaluation of segmentation commonly used in image processing with reviews of their models. Then multicomponent synthetic images of known composition are applied to these criteria to explore the operation and evaluate its relevance. The results show that choosing an assessment method depends on the purpose, however the criterion of Zeboudj appears powerful for the evaluation of region segmentations for properly separated classes, on the contrary the criteria of Levine-Nazif and Borsotti are adapted to the methods of classification and permit to build homogeneous regions or classes. The values of the Rosenbeger criterion are generally low and similar, so hard to make a comparison of segmentations with this criterion.

Development and Parallelization of an Improved 2D Moving Window Standard Deviation Python Routine for Image Segmentation Purposes

Two additional features are particularly useful in pixelwise satellite data segmentation using neural networks: one results from local window averaging around each pixel (MWA) and another uses a standard deviation estimator (MWSD) instead of the average. While the former’s complexity has already been solved to a satisfying minimum, the latter did not. This article proposes a new algorithm that can substitute a naive MWSD, by making the complexity of the computational process fall from O(N2n2) to O(N2n), where N is a square input array side, and n is the moving window’s side length. The Numba python compiler was used to make python a competitive high-performance computing language in our optimizations. Our results show efficiency benchmars

EFFECTIVE IMAGE SEGMENTATION FRAMEWORK FOR GAUSSIAN MIXTURE MODEL INCORPORATING LOCAL INFORMATION

A new two-step framework is proposed for image segmentation. In the first step, the gray-value distribution of the given image is reshaped to have larger inter-class variance and less intra-class variance. In the sec- ond step, the discriminant-based methods or clustering-based methods are performed on the reformed distribution. It is focused on the typical clustering methods-Gaussian mixture model （GMM） and its variant to demonstrate the feasibility of the framework. Due to the independence of the first step in its second step, it can be integrated into the pixel-based and the histogram-based methods to improve their segmentation quality. The experiments on artificial and real images show that the framework can achieve effective and robust segmentation results.

基于SAM&ImageJ图像处理的堆石混凝土坝层面露石率研究

堆石混凝土坝层面的外露块石为上下层提供了重要的啮合作用,其投影面积比例是科学评价层间抗剪性能的重要指标。采用国际最新Meta AI模型segment anything model(SAM)对层面外露堆石进行自动图像分割,并基于ImageJ软件对SAM识别后的图片进行再加工与图像计算,利用平滑、差分算法、中值滤波等方法精准标定外露堆石,二值化后计算得到层面露石率。结果表明:SAM图像预分割可识别约90%的外露堆石,经过ImageJ二次图像处理后可有效提高小粒径堆石的识别精度,对比手动标注结果误差在±3%以内。以贵州省两座水库的工程应用为例,对浇筑仓面进行分区预处理,结果发现靠近上游、中部、下游不同区域的露石率差别较大,计算得到的层面露石率以10%~30%居多,其中堆石入仓运输通道区域的露石率较低。研究内容与结论可为堆石混凝土结构层间界面抗剪力学性能和大坝蓄水安全稳定的研究提供参考与借鉴。

Extraction of auroral oval boundaries from UVI images: A new FLICM clustering-based method and its evaluation

Based on the fuzzy local information c-means （FLICM） clustering algorithm, a new method is developed for extracting the equatorward and poleward boundaries of the auroral oval from images acquired by the Ultraviolet Imager （UVI） aboard the POLAR satellite. First, the method iteratively segments the UVI image with the FLICM clustering algorithm, according to an integrity criterion for the segmented auroral oval. Then, possible gaps in the extracted auroral oval are filled, based on prior knowledge of its shape. To evaluate the method objectively, the extracted boundaries are compared with the precipitating electron boundaries determined from DMSP satellite precipitation particle data. The evaluation results demonstrate that the proposed method generates more accurate auroral boundaries than traditional methods.

High-Dimensional Spatial Standardization Algorithm for Diffusion Tensor Image Registration

Three high dimensional spatial standardization algorithms are used for diffusion tensor image(DTI)registration,and seven kinds of methods are used to evaluate their performances.Firstly,the template used in this paper was obtained by spatial transformation of 16 subjects by means of tensor-based standardization.Then,high dimensional standardization algorithms for diffusion tensor images,including fractional anisotropy(FA)based diffeomorphic registration algorithm,FA based elastic registration algorithm and tensor-based registration algorithm,were performed.Finally,7 kinds of evaluation methods,including normalized standard deviation,dyadic coherence,diffusion cross-correlation,overlap of eigenvalue-eigenvector pairs,Euclidean distance of diffusion tensor,and Euclidean distance of the deviatoric tensor and deviatoric of tensors,were used to qualitatively compare and summarize the above standardization algorithms.Experimental results revealed that the high-dimensional tensor-based standardization algorithms perform well and can maintain the consistency of anatomical structures.

Dual-Branch-UNet: A Dual-Branch Convolutional Neural Network for Medical Image Segmentation

In intelligent perception and diagnosis of medical equipment,the visual and morphological changes in retinal vessels are closely related to the severity of cardiovascular diseases(e.g.,diabetes and hypertension).Intelligent auxiliary diagnosis of these diseases depends on the accuracy of the retinal vascular segmentation results.To address this challenge,we design a Dual-Branch-UNet framework,which comprises a Dual-Branch encoder structure for feature extraction based on the traditional U-Net model for medical image segmentation.To be more explicit,we utilize a novel parallel encoder made up of various convolutional modules to enhance the encoder portion of the original U-Net.Then,image features are combined at each layer to produce richer semantic data and the model’s capacity is adjusted to various input images.Meanwhile,in the lower sampling section,we give up pooling and conduct the lower sampling by convolution operation to control step size for information fusion.We also employ an attentionmodule in the decoder stage to filter the image noises so as to lessen the response of irrelevant features.Experiments are verified and compared on the DRIVE and ARIA datasets for retinal vessels segmentation.The proposed Dual-Branch-UNet has proved to be superior to other five typical state-of-the-art methods.

Recognition and Classification of Pomegranate Leaves Diseases by Image Processing and Machine Learning Techniques

Disease recognition in plants is one of the essential problems in agricultural image processing.This article focuses on designing a framework that can recognize and classify diseases on pomegranate plants exactly.The framework utilizes image processing techniques such as image acquisition,image resizing,image enhancement,image segmentation,ROI extraction(region of interest),and feature extraction.An image dataset related to pomegranate leaf disease is utilized to implement the framework,divided into a training set and a test set.In the implementation process,techniques such as image enhancement and image segmentation are primarily used for identifying ROI and features.An image classification will then be implemented by combining a supervised learning model with a support vector machine.The proposed framework is developed based on MATLAB with a graphical user interface.According to the experimental results,the proposed framework can achieve 98.39%accuracy for classifying diseased and healthy leaves.Moreover,the framework can achieve an accuracy of 98.07%for classifying diseases on pomegranate leaves.

A method of remote sensing image water segmentation based on adaptive morphological elliptical structuring elements

The use of visible and infrared remote sensing images to calculate the water area is an effective means to grasp the basic situation of water resources,and water segmentation is the premise of statistics.Generally,the edge features of the water in the remote sensing images are complex.When the traditional morphology is used for image segmentation,it is easy to change the image edge and affect the accuracy of image segmentation because the fixed structuring elements are used to perform morphological operations on the image.To segment water in the remote sensing image accurately,a remote sensing image water segmentation method based on adaptive morphological elliptical structuring elements is proposed.Firstly,the eigenvalue and eigenvector of the image are estimated by linear structure tensor,and the elliptical structuring elements are constructed by the eigenvalue and eigenvector.Then adaptive morphological operations are defined,combining the close operation to eliminate the influence of dark detail noise on water without overstretching the water edge,so that the water edge can be maintained more accurately.Finally,on this basis,the water area can be segmented by gray slice.The experimental results show that the proposed method has higher segmentation accuracy and the average segmentation error is less than 1.43%.

Unsupervised Segmentation Method of Multicomponent Images based on Fuzzy Connectivity Analysis in the Multidimensional Histograms

Image segmentation denotes a process for partitioning an image into distinct regions, it plays an important role in interpretation and decision making. A large variety of segmentation methods has been developed;among them, multidimensional histogram methods have been investigated but their implementation stays difficult due to the big size of histograms. We present an original method for segmenting n-D (where n is the number of components in image) images or multidimensional images in an unsupervised way using a fuzzy neighbourhood model. It is based on the hierarchical analysis of full n-D compact histograms integrating a fuzzy connected components labelling algorithm that we have realized in this work. Each peak of the histo- gram constitutes a class kernel, as soon as it encloses a number of pixels greater than or equal to a secondary arbitrary threshold knowing that a first threshold was set to define the degree of binary fuzzy similarity be- tween pixels. The use of a lossless compact n-D histogram allows a drastic reduction of the memory space necessary for coding it. As a consequence, the segmentation can be achieved without reducing the colors population of images in the classification step. It is shown that using n-D compact histograms, instead of 1-D and 2-D ones, leads to better segmentation results. Various images were segmented;the evaluation of the quality of segmentation in supervised and unsupervised of segmentation method proposed compare to the classification method k-means gives better results. It thus highlights the relevance of our approach, which can be used for solving many problems of segmentation.

THE APPLICATION OF MULTILAYER FEEDFORWARD NETWORK FOR IMAGE SEGMENTATION

The multilayer feedforward network is used for image segmentation. This paper deals with the procedure of achieving the learning patterns and the method of improving the learning rate. The experiment shows that the image segmentation can get better result from using the multilayer feedforward network.

Adaptive Boundary and Semantic Composite Segmentation Method for Individual Objects in Aerial Images

There are two types of methods for image segmentation.One is traditional image processing methods,which are sensitive to details and boundaries,yet fail to recognize semantic information.The other is deep learning methods,which can locate and identify different objects,but boundary identifications are not accurate enough.Both of them cannot generate entire segmentation information.In order to obtain accurate edge detection and semantic information,an Adaptive Boundary and Semantic Composite Segmentation method(ABSCS)is proposed.This method can precisely semantic segment individual objects in large-size aerial images with limited GPU performances.It includes adaptively dividing and modifying the aerial images with the proposed principles and methods,using the deep learning method to semantic segment and preprocess the small divided pieces,using three traditional methods to segment and preprocess original-size aerial images,adaptively selecting traditional results tomodify the boundaries of individual objects in deep learning results,and combining the results of different objects.Individual object semantic segmentation experiments are conducted by using the AeroScapes dataset,and their results are analyzed qualitatively and quantitatively.The experimental results demonstrate that the proposed method can achieve more promising object boundaries than the original deep learning method.This work also demonstrates the advantages of the proposed method in applications of point cloud semantic segmentation and image inpainting.

Image Segmentation Based on Block Level and Hybrid Directional Local Extrema

In the recent decade,the digitalization of various tasks has added great flexibility to human lifestyle and has changed daily routine activities of communities.Image segmentation is a key step in digitalization.Segmentation plays a key role in almost all areas of image processing,and various approaches have been proposed for image segmentation.In this paper,a novel approach is proposed for image segmentation using a nonuniform adaptive strategy.Region-based image segmentation along with a directional binary pattern generated a better segmented image.An adaptive mask of 8×8 was circulated over the pixels whose bit value was 1 in the generated directional binary pattern.Segmentation was performed in three phases:first,an image was divided into sub-images or image chunks;next,the image patches were taken as input,and an adaptive threshold was generated;and finally the image chunks were processed separately by convolving the adaptive mask on the image chunks.Gradient and Laplacian of Gaussian algorithms along with directional extrema patterns provided a double check for boundary pixels.The proposed approach was tested on chunks of varying sizes,and after multiple iterations,it was found that a block size of 8×8 performs better than other chunks or block sizes.The accuracy of the segmentation technique was measured in terms of the count of ill regions,which were extracted after the segmentation process.

Hierarchical Image Segmentation Using a Combined Geometrical and Feature Based Approach

This paper presents a fully automatic segmentation algorithm based on geometrical and local attributes of color images. This method incorporates a hierarchical assessment scheme into any general segmentation algorithm for which the segmentation sensitivity can be changed through parameters. The parameters are varied to create different segmentation levels in the hierarchy. The algorithm examines the consistency of segments based on local features and their relationships with each other, and selects segments at different levels to generate a final segmentation. This adaptive parameter variation scheme provides an automatic way to set segmentation sensitivity parameters locally according to each region's characteristics instead of the entire image. The algorithm does not require any training dataset. The geometrical attributes can be defined by a shape prior for specific applications, i.e. targeting objects of interest, or by one or more general constraint(s) such as boundaries between regions for non-specific applications. Using mean shift as the general segmentation algorithm, we show that our hierarchical approach generates segments that satisfy geometrical properties while conforming with local properties. In the case of using a shape prior, the algorithm can cope with partial occlusions. Evaluation is carried out on the Berkeley Segmentation Dataset and Benchmark (BSDS300) (general natural images) and on geo-spatial images (with specific shapes of interest). The F-measure for our proposed algorithm, i.e. the harmonic mean between precision and recall rates, is 64.2% on BSDS300, outperforming the same segmentation algorithm in its standard non-hierarchical variant.

Medical ultrasound image segmentation by modified local histogram range image method

Fast and satisfied medical ultrasound segmentation is known to be difficult due to speckle noises and other artificial effects. Since speckle noise is formed from random signals which are emitted by an ultrasound system, we can’t encounter the same way as other image noises. Lack of information in ultrasound images is another problem. Thus, segmentation results may not be accurate enough by means of customary image segmentation methods. Those methods that can specify undesirable effects and segment them by eliminating artificial effects, should be chosen. It seems to be a complicated work with high computational load. The current study presents a different approach to ultrasound image segmentation that relies mainly on local evaluation, named as local histogram range image method which is modified by means of discrete wavelet transform. Thus, a significant decrease in computational load is then achieved. The results show that it is possible for tissues to be segmented correctly.

A Hierarchical Grab Cut Image Segmentation Algorithm

This paper aims to speed up a segmentation algorithm “Grab Cut” by separating the process of segmentation into hierarchical steps. The Grab Cut algorithm segments images by means of the color clustering concept and the process requires a lot of iteration for it to get converged. Therefore, it is a time-consuming process which we are interested in improving this process. In this study, we adopt the idea of hierarchical processing. The first step is to compute at low resolution to make the iteration much faster, and the second step use the result of the first step to carry on iteration at original resolution so that the total execution time can be reduced. Specifically speaking, segmentation of a low resolution image will lead to high-speed and similar-segmentation result to the segmentation at original resolution. Hence, once the iterations at low resolution have converged, we can utilize the parameters of segmentation result to initialize the next segmentation on original resolution. This way, the number of iteration of segmentation at original resolution will be reduced through the initialization of those parameters. Since the execution time of low resolution images is relatively short, the total hierarchical execution time will be reduced consequently. Also, we made a comparison among the four methods of reduction on image resolution. Finally, we found that reducing the number of basins by “Median Filter” resulted in best segmentation speed.