Semantic segmentation-based semantic communication system for image transmission

With the rapid development of artificial intelligence and the widespread use of the Internet of Things, semantic communication, as an emerging communication paradigm, has been attracting great interest. Taking image transmission as an example, from the semantic communication's view, not all pixels in the images are equally important for certain receivers. The existing semantic communication systems directly perform semantic encoding and decoding on the whole image, in which the region of interest cannot be identified. In this paper, we propose a novel semantic communication system for image transmission that can distinguish between Regions Of Interest (ROI) and Regions Of Non-Interest (RONI) based on semantic segmentation, where a semantic segmentation algorithm is used to classify each pixel of the image and distinguish ROI and RONI. The system also enables high-quality transmission of ROI with lower communication overheads by transmissions through different semantic communication networks with different bandwidth requirements. An improved metric θPSNR is proposed to evaluate the transmission accuracy of the novel semantic transmission network. Experimental results show that our proposed system achieves a significant performance improvement compared with existing approaches, namely, existing semantic communication approaches and the conventional approach without semantics.

A Comprehensive Systematic Review: Advancements in Skin Cancer Classification and Segmentation Using the ISIC Dataset

The International Skin Imaging Collaboration(ISIC)datasets are pivotal resources for researchers in machine learning for medical image analysis,especially in skin cancer detection.These datasets contain tens of thousands of dermoscopic photographs,each accompanied by gold-standard lesion diagnosis metadata.Annual challenges associated with ISIC datasets have spurred significant advancements,with research papers reporting metrics surpassing those of human experts.Skin cancers are categorized into melanoma and non-melanoma types,with melanoma posing a greater threat due to its rapid potential for metastasis if left untreated.This paper aims to address challenges in skin cancer detection via visual inspection and manual examination of skin lesion images,processes historically known for their laboriousness.Despite notable advancements in machine learning and deep learning models,persistent challenges remain,largely due to the intricate nature of skin lesion images.We review research on convolutional neural networks(CNNs)in skin cancer classification and segmentation,identifying issues like data duplication and augmentation problems.We explore the efficacy of Vision Transformers(ViTs)in overcoming these challenges within ISIC dataset processing.ViTs leverage their capabilities to capture both global and local relationships within images,reducing data duplication and enhancing model generalization.Additionally,ViTs alleviate augmentation issues by effectively leveraging original data.Through a thorough examination of ViT-based methodologies,we illustrate their pivotal role in enhancing ISIC image classification and segmentation.This study offers valuable insights for researchers and practitioners looking to utilize ViTs for improved analysis of dermatological images.Furthermore,this paper emphasizes the crucial role of mathematical and computational modeling processes in advancing skin cancer detection methodologies,highlighting their significance in improving algorithmic performance and interpretability.

Semantic Segmentation of Lumbar Vertebrae Using Meijering U-Net(MU-Net)on Spine Magnetic Resonance Images

Lower back pain is one of the most common medical problems in the world and it is experienced by a huge percentage of people everywhere.Due to its ability to produce a detailed view of the soft tissues,including the spinal cord,nerves,intervertebral discs,and vertebrae,Magnetic Resonance Imaging is thought to be the most effective method for imaging the spine.The semantic segmentation of vertebrae plays a major role in the diagnostic process of lumbar diseases.It is difficult to semantically partition the vertebrae in Magnetic Resonance Images from the surrounding variety of tissues,including muscles,ligaments,and intervertebral discs.U-Net is a powerful deep-learning architecture to handle the challenges of medical image analysis tasks and achieves high segmentation accuracy.This work proposes a modified U-Net architecture namely MU-Net,consisting of the Meijering convolutional layer that incorporates the Meijering filter to perform the semantic segmentation of lumbar vertebrae L1 to L5 and sacral vertebra S1.Pseudo-colour mask images were generated and used as ground truth for training the model.The work has been carried out on 1312 images expanded from T1-weighted mid-sagittal MRI images of 515 patients in the Lumbar Spine MRI Dataset publicly available from Mendeley Data.The proposed MU-Net model for the semantic segmentation of the lumbar vertebrae gives better performance with 98.79%of pixel accuracy(PA),98.66%of dice similarity coefficient(DSC),97.36%of Jaccard coefficient,and 92.55%mean Intersection over Union(mean IoU)metrics using the mentioned dataset.

Automated lung segmentation algorithm for CAD system of thoracic CT

Objective: To design and test the accuracy and efficiency of our lung segmentation algorithm on thoracic CT image in computer-aided diagnostic (CAD) system, especially on the segmentation between left and right lungs. Methods: We put forward the base frame of our lung segmentation firstly. Then, using optimal thresholding and mathematical morphologic methods, we acquired the rough image of lung segmentation. Finally, we presented a fast self-fit segmentation refinement algorithm, adapting to the unsuccessful left-right lung segmentation of thredsholding. Then our algorithm was used to CT scan images of 30 patients and the results were compared with those made by experts. Results: Experiments on clinical 2-D pulmonary images showed the results of our algorithm were very close to the expert’s manual outlines, and it was very effective for the separation of left and right lungs with a successful segmentation ratio 94.8%. Conclusion: It is a practicable fast lung segmentation algorithm for CAD system on thoracic CT image.

Improved organs at risk segmentation based on modified U‐Net with self‐attention and consistency regularisation

Cancer is one of the leading causes of death in the world,with radiotherapy as one of the treatment options.Radiotherapy planning starts with delineating the affected area from healthy organs,called organs at risk(OAR).A new approach to automatic OAR seg-mentation in the chest cavity in Computed Tomography(CT)images is presented.The proposed approach is based on the modified U‐Net architecture with the ResNet‐34 encoder,which is the baseline adopted in this work.The new two‐branch CS‐SA U‐Net architecture is proposed,which consists of two parallel U‐Net models in which self‐attention blocks with cosine similarity as query‐key similarity function(CS‐SA)blocks are inserted between the encoder and decoder,which enabled the use of con-sistency regularisation.The proposed solution demonstrates state‐of‐the‐art performance for the problem of OAR segmentation in CT images on the publicly available SegTHOR benchmark dataset in terms of a Dice coefficient(oesophagus-0.8714,heart-0.9516,trachea-0.9286,aorta-0.9510)and Hausdorff distance(oesophagus-0.2541,heart-0.1514,trachea-0.1722,aorta-0.1114)and significantly outperforms the baseline.The current approach is demonstrated to be viable for improving the quality of OAR segmentation for radiotherapy planning.

An Improved Lung Cancer Segmentation Based on Nature-Inspired Optimization Approaches

The distinction and precise identification of tumor nodules are crucial for timely lung cancer diagnosis andplanning intervention. This research work addresses the major issues pertaining to the field of medical imageprocessing while focusing on lung cancer Computed Tomography (CT) images. In this context, the paper proposesan improved lung cancer segmentation technique based on the strengths of nature-inspired approaches. Thebetter resolution of CT is exploited to distinguish healthy subjects from those who have lung cancer. In thisprocess, the visual challenges of the K-means are addressed with the integration of four nature-inspired swarmintelligent techniques. The techniques experimented in this paper are K-means with Artificial Bee Colony (ABC),K-means with Cuckoo Search Algorithm (CSA), K-means with Particle Swarm Optimization (PSO), and Kmeanswith Firefly Algorithm (FFA). The testing and evaluation are performed on Early Lung Cancer ActionProgram (ELCAP) database. The simulation analysis is performed using lung cancer images set against metrics:precision, sensitivity, specificity, f-measure, accuracy,Matthews Correlation Coefficient (MCC), Jaccard, and Dice.The detailed evaluation shows that the K-means with Cuckoo Search Algorithm (CSA) significantly improved thequality of lung cancer segmentation in comparison to the other optimization approaches utilized for lung cancerimages. The results exhibit that the proposed approach (K-means with CSA) achieves precision, sensitivity, and Fmeasureof 0.942, 0.964, and 0.953, respectively, and an average accuracy of 93%. The experimental results prove thatK-meanswithABC,K-meanswith PSO,K-meanswith FFA, andK-meanswithCSAhave achieved an improvementof 10.8%, 13.38%, 13.93%, and 15.7%, respectively, for accuracy measure in comparison to K-means segmentationfor lung cancer images. Further, it is highlighted that the proposed K-means with CSA have achieved a significantimprovement in accuracy, hence can be utilized by researchers for improved segmentation processes of medicalimage datasets for identifying the targeted region of interest.

A Comparative Study of Automated Segmentation Methods for Use in a Microwave Tomography System for Imaging Intracerebral Hemorrhage in Stroke Patients

Microwave technology offers the possibility for pre-hospital stroke detection as we have previously demonstrated using non-imaging diagnostics. The focus in this paper is on image-based diagnostics wherein the technical and computational complexities of image reconstruction are a challenge for clinical realization. Herein we investigate whether information about a patient’s brain anatomy obtained prior to a stroke event can be used to facilitate image-based stroke diagnostics. A priori information can be obtained by segmenting the patient’s head tissues from magnetic resonance images. Expert manual segmentation is presently the gold standard, but it is laborious and subjective. A fully automatic method is thus desirable. This paper presents an evaluation of several such methods using both synthetic magnetic resonance imaging (MRI) data and real data from four healthy subjects. The segmentation was performed on the full 3D MRI data, whereas the electromagnetic evaluation was performed using a 2D slice. The methods were evaluated in terms of: i) tissue classification accuracy over all tissues with respect to ground truth, ii) the accuracy of the simulated electromagnetic wave propagation through the head, and iii) the accuracy of the image reconstruction of the hemorrhage. The segmentation accuracy was measured in terms of the degree of overlap (Dice score) with the ground truth. The electromagnetic simulation accuracy was measured in terms of signal deviation relative to the simulation based on the ground truth. Finally, the image reconstruction accuracy was measured in terms of the Dice score, relative error of dielectric properties, and visual comparison between the true and reconstructed intracerebral hemorrhage. The results show that accurate segmentation of tissues (Dice score = 0.97) from the MRI data can lead to accurate image reconstruction (relative error = 0.24) for the intracerebral hemorrhage in the subject’s brain. They also suggest that accurate automated segmentation can be used as a surrogate for manual segmentation and can facilitate the rapid diagnosis of intracerebral hemorrhage in stroke patients using a microwave imaging system.

An Efficient Liver-Segmentation System Based on a Level-Set Method and Consequent Processes

This paper presents an efficient liver-segmentation system developed by combining three ideas under the operations of a level-set method and consequent processes. First, an effective initial process creates mask and seed regions. The mask regions assist in prevention of leakage regions due to an overlap of gray-intensities between liver and another soft-tissue around ribs and verte-brae. The seed regions are allocated inside the liver to measure statistical values of its gray-intensities. Second, we introduce liver-corrective images to represent statistical regions of the liver and preserve edge information. These images help a geodesic active contour (GAC) to move without obstruction from high level of image noises. Lastly, the computation time in a level-set based on reaction-diffusion evolution and the GAC method is reduced by using a concept of multi-resolution. We applied the proposed system to 40 sets of 3D CT-liver data, which were acquired from four patients (10 different sets per patient) by a 4D-CT imaging system. The segmentation results showed 86.38% ± 4.26% (DSC: 91.38% ± 2.99%) of similarities to outlines of manual delineation provided by a radiologist. Meanwhile, the results of liver segmentation only using edge images presented 79.17% ± 5.15% or statistical regions showed 74.04% ± 9.77% of similarities.

Automatic Segmentation and Detection System for Varicocele Using Ultrasound Images

The enlarged veins in the pampiniform venous plexus,known as varicocele disease,are typically identified using ultrasound scans.Themedical diagnosis of varicocele is based on examinations made in three positions taken to the right and left testicles of the male patient.The proposed system is designed to determine whether a patient is affected.Varicocele is more frequent on the left side of the scrotum than on the right and physicians commonly depend on the supine position more than other positions.Therefore,the experimental results of this study focused on images taken in the supine position of the left testicles of patients.There are two possible vein structures in each image:a cross-section(circular)and a tube(non-circular)structure.This proposed system identifies dilated(varicocele)veins of these structures in ultrasound images in three stages:preprocessing,processing,and detection and measurement.These three stages are applied in three different color modes:Grayscale,Red-Green-Blue(RGB),and Hue,Saturation,and Value(HSV).In the preprocessing stage,the region of interest enclosing the pampiniform plexus area is extracted using a median filter and threshold segmentation.Then,the processing stage employs different filters to perform image denoising.Finally,edge detection is applied in multiple steps and the detected veins are measured to determine if dilated veins exist.Overall implementation results showed the proposed system is faster andmore effective than the previous work.

Visual Semantic Segmentation Based on Few/Zero-Shot Learning:An Overview

Visual semantic segmentation aims at separating a visual sample into diverse blocks with specific semantic attributes and identifying the category for each block,and it plays a crucial role in environmental perception.Conventional learning-based visual semantic segmentation approaches count heavily on largescale training data with dense annotations and consistently fail to estimate accurate semantic labels for unseen categories.This obstruction spurs a craze for studying visual semantic segmentation with the assistance of few/zero-shot learning.The emergence and rapid progress of few/zero-shot visual semantic segmentation make it possible to learn unseen categories from a few labeled or even zero-labeled samples,which advances the extension to practical applications.Therefore,this paper focuses on the recently published few/zero-shot visual semantic segmentation methods varying from 2D to 3D space and explores the commonalities and discrepancies of technical settlements under different segmentation circumstances.Specifically,the preliminaries on few/zeroshot visual semantic segmentation,including the problem definitions,typical datasets,and technical remedies,are briefly reviewed and discussed.Moreover,three typical instantiations are involved to uncover the interactions of few/zero-shot learning with visual semantic segmentation,including image semantic segmentation,video object segmentation,and 3D segmentation.Finally,the future challenges of few/zero-shot visual semantic segmentation are discussed.

AN IMAGE SEGMENTATION APPROACH BASED ON FUZZY-NEURAL-NETWORK HYBRID SYSTEM

This paper presents a new solution to the image segmentation problem, which is based on fuzzy-neural-network hybrid system (FNNHS). This approach can use the experiential knowledge and the ability of neural networks which learn knowledge from the examples, to obtain the well performed fuzzy rules. Furthermore this fuzzy inference system is completed by neural network structure which can work in parallel. The segmentation process consists of pre-segmentation based on region growing algorithm and region merging based on FNNHS. The experimental results on the complicated image manifest the utility of this method.

EVALUATION BASED SEGMENTATION ALGORITHM OPTIMIZATION: IDEA AND SYSTEM

This paper conies up with a new idea that tries to optimize the performance of image segmentation algorithms based on their objective evaluation knowledge. A prototype expert system is designed and implemented according to this idea. Kxperimental results indicate that this system is feasible and practical. This idea also offers an efficient approach for algorithm optimization of image processing and analysis.

Multilevel Attention Unet Segmentation Algorithmfor Lung Cancer Based on CT Images

Lung cancer is a malady of the lungs that gravely jeopardizes human health.Therefore,early detection and treatment are paramount for the preservation of human life.Lung computed tomography(CT)image sequences can explicitly delineate the pathological condition of the lungs.To meet the imperative for accurate diagnosis by physicians,expeditious segmentation of the region harboring lung cancer is of utmost significance.We utilize computer-aided methods to emulate the diagnostic process in which physicians concentrate on lung cancer in a sequential manner,erect an interpretable model,and attain segmentation of lung cancer.The specific advancements can be encapsulated as follows:1)Concentration on the lung parenchyma region:Based on 16-bit CT image capturing and the luminance characteristics of lung cancer,we proffer an intercept histogram algorithm.2)Focus on the specific locus of lung malignancy:Utilizing the spatial interrelation of lung cancer,we propose a memory-based Unet architecture and incorporate skip connections.3)Data Imbalance:In accordance with the prevalent situation of an overabundance of negative samples and a paucity of positive samples,we scrutinize the existing loss function and suggest a mixed loss function.Experimental results with pre-existing publicly available datasets and assembled datasets demonstrate that the segmentation efficacy,measured as Area Overlap Measure(AOM)is superior to 0.81,which markedly ameliorates in comparison with conventional algorithms,thereby facilitating physicians in diagnosis.

Two-Staged Method for Ice Channel Identification Based on Image Segmentation and Corner Point Regression

Identification of the ice channel is the basic technology for developing intelligent ships in ice-covered waters,which is important to ensure the safety and economy of navigation.In the Arctic,merchant ships with low ice class often navigate in channels opened up by icebreakers.Navigation in the ice channel often depends on good maneuverability skills and abundant experience from the captain to a large extent.The ship may get stuck if steered into ice fields off the channel.Under this circumstance,it is very important to study how to identify the boundary lines of ice channels with a reliable method.In this paper,a two-staged ice channel identification method is developed based on image segmentation and corner point regression.The first stage employs the image segmentation method to extract channel regions.In the second stage,an intelligent corner regression network is proposed to extract the channel boundary lines from the channel region.A non-intelligent angle-based filtering and clustering method is proposed and compared with corner point regression network.The training and evaluation of the segmentation method and corner regression network are carried out on the synthetic and real ice channel dataset.The evaluation results show that the accuracy of the method using the corner point regression network in the second stage is achieved as high as 73.33%on the synthetic ice channel dataset and 70.66%on the real ice channel dataset,and the processing speed can reach up to 14.58frames per second.

Automated neurosurgical video segmentation and retrieval system

Medical video repositories play important roles for many health-related issues such as medical imaging, medical research and education, medical diagnostics and training of medical professionals. Due to the increasing availability of the digital video data, indexing, annotating and the retrieval of the information are crucial. Since performing these processes are both computationally expensive and time consuming, automated systems are needed. In this paper, we present a medical video segmentation and retrieval research initiative. We describe the key components of the system including video segmentation engine, image retrieval engine and image quality assessment module. The aim of this research is to provide an online tool for indexing, browsing and retrieving the neurosurgical videotapes. This tool will allow people to retrieve the specific information in a long video tape they are interested in instead of looking through the entire content.

Improving the Segmentation of Arabic Handwriting Using Ligature Detection Technique

Recognizing handwritten characters remains a critical and formidable challenge within the realm of computervision. Although considerable strides have been made in enhancing English handwritten character recognitionthrough various techniques, deciphering Arabic handwritten characters is particularly intricate. This complexityarises from the diverse array of writing styles among individuals, coupled with the various shapes that a singlecharacter can take when positioned differently within document images, rendering the task more perplexing. Inthis study, a novel segmentation method for Arabic handwritten scripts is suggested. This work aims to locatethe local minima of the vertical and diagonal word image densities to precisely identify the segmentation pointsbetween the cursive letters. The proposed method starts with pre-processing the word image without affectingits main features, then calculates the directions pixel density of the word image by scanning it vertically and fromangles 30° to 90° to count the pixel density fromall directions and address the problem of overlapping letters, whichis a commonly attitude in writing Arabic texts by many people. Local minima and thresholds are also determinedto identify the ideal segmentation area. The proposed technique is tested on samples obtained fromtwo datasets: Aself-curated image dataset and the IFN/ENIT dataset. The results demonstrate that the proposed method achievesa significant improvement in the proportions of cursive segmentation of 92.96% on our dataset, as well as 89.37%on the IFN/ENIT dataset.

Real-time human segmentation by BowtieNet and a SLAM-based human AR system

Background Generally, it is difficult to obtain accurate pose and depth for a non-rigid moving object from a single RGB camera to create augmented reality (AR). In this study, we build an augmented reality system from a single RGB camera for a non-rigid moving human by accurately computing pose and depth, for which two key tasks are segmentation and monocular Simultaneous Localization and Mapping (SLAM). Most existing monocular SLAM systems are designed for static scenes, while in this AR system, the human body is always moving and non-rigid. Methods In order to make the SLAM system suitable for a moving human, we first segment the rigid part of the human in each frame. A segmented moving body part can be regarded as a static object, and the relative motions between each moving body part and the camera can be considered the motion of the camera. Typical SLAM systems designed for static scenes can then be applied. In the segmentation step of this AR system, we first employ the proposed BowtieNet, which adds the atrous spatial pyramid pooling (ASPP) of DeepLab between the encoder and decoder of SegNet to segment the human in the original frame, and then we use color information to extract the face from the segmented human area. Results Based on the human segmentation results and a monocular SLAM, this system can change the video background and add a virtual object to humans. Conclusions The experiments on the human image segmentation datasets show that BowtieNet obtains state-of-the-art human image segmentation performance and enough speed for real-time segmentation. The experiments on videos show that the proposed AR system can robustly add a virtual object to humans and can accurately change the video background.

Text Mining Based on the Korean Word Segmentation System in the Context of Big Data

Text mining is a text data analysis,found that the relationship between concepts and underlying concepts from unstructured text,it is extracted from large text database has not yet been realized patterns or associations,some information retrieval and text processing system can find the relationship between words and paragraphs.This article first describes the data sources and a brief introduction to the related platforms and functional components.Secondly,it explains the Chinese word segmentation and the Korean word segmentation system.At last,it takes the news,documents and materials of the Korean Peninsula as well as the various public opinion data on the network as the basic data for the research.The examples of word frequency graph and word cloud graph is carried out to show the results of text mining through Chinese word segmentation system and Korean word segmentation system.

A Systematic Literature Review of Deep Learning Algorithms for Segmentation of the COVID-19 Infection

Coronavirus has infected more than 753 million people,ranging in severity from one person to another,where more than six million infected people died worldwide.Computer-aided diagnostic(CAD)with artificial intelligence(AI)showed outstanding performance in effectively diagnosing this virus in real-time.Computed tomography is a complementary diagnostic tool to clarify the damage of COVID-19 in the lungs even before symptoms appear in patients.This paper conducts a systematic literature review of deep learning methods for classifying the segmentation of COVID-19 infection in the lungs.We used the methodology of systematic reviews and meta-analyses(PRISMA)flow method.This research aims to systematically analyze the supervised deep learning methods,open resource datasets,data augmentation methods,and loss functions used for various segment shapes of COVID-19 infection from computerized tomography(CT)chest images.We have selected 56 primary studies relevant to the topic of the paper.We have compared different aspects of the algorithms used to segment infected areas in the CT images.Limitations to deep learning in the segmentation of infected areas still need to be developed to predict smaller regions of infection at the beginning of their appearance.

Empowering Diagnosis: Cutting-Edge Segmentation and Classification in Lung Cancer Analysis

Lung cancer is a leading cause of global mortality rates.Early detection of pulmonary tumors can significantly enhance the survival rate of patients.Recently,various Computer-Aided Diagnostic(CAD)methods have been developed to enhance the detection of pulmonary nodules with high accuracy.Nevertheless,the existing method-ologies cannot obtain a high level of specificity and sensitivity.The present study introduces a novel model for Lung Cancer Segmentation and Classification(LCSC),which incorporates two improved architectures,namely the improved U-Net architecture and the improved AlexNet architecture.The LCSC model comprises two distinct stages.The first stage involves the utilization of an improved U-Net architecture to segment candidate nodules extracted from the lung lobes.Subsequently,an improved AlexNet architecture is employed to classify lung cancer.During the first stage,the proposed model demonstrates a dice accuracy of 0.855,a precision of 0.933,and a recall of 0.789 for the segmentation of candidate nodules.The suggested improved AlexNet architecture attains 97.06%accuracy,a true positive rate of 96.36%,a true negative rate of 97.77%,a positive predictive value of 97.74%,and a negative predictive value of 96.41%for classifying pulmonary cancer as either benign or malignant.The proposed LCSC model is tested and evaluated employing the publically available dataset furnished by the Lung Image Database Consortium and Image Database Resource Initiative(LIDC-IDRI).This proposed technique exhibits remarkable performance compared to the existing methods by using various evaluation parameters.