Enhanced Tunicate Swarm Optimization with Transfer Learning Enabled Medical Image Analysis System

Medical image analysis is an active research topic,with thousands of studies published in the past few years.Transfer learning(TL)including convolutional neural networks(CNNs)focused to enhance efficiency on an innovative task using the knowledge of the same tasks learnt in advance.It has played a major role in medical image analysis since it solves the data scarcity issue along with that it saves hardware resources and time.This study develops an EnhancedTunicate SwarmOptimization withTransfer Learning EnabledMedical Image Analysis System(ETSOTL-MIAS).The goal of the ETSOTL-MIAS technique lies in the identification and classification of diseases through medical imaging.The ETSOTL-MIAS technique involves the Chan Vese segmentation technique to identify the affected regions in the medical image.For feature extraction purposes,the ETSOTL-MIAS technique designs a modified DarkNet-53 model.To avoid the manual hyperparameter adjustment process,the ETSOTLMIAS technique exploits the ETSO algorithm,showing the novelty of the work.Finally,the classification of medical images takes place by random forest(RF)classifier.The performance validation of the ETSOTL-MIAS technique is tested on a benchmark medical image database.The extensive experimental analysis showed the promising performance of the ETSOTL-MIAS technique under different measures.

Unified Analysis Specific to the Medical Field in the Interpretation of Medical Images through the Use of Deep Learning

Deep learning (DL) has seen an exponential development in recent years, with major impact in many medical fields, especially in the field of medical image. The purpose of the work converges in determining the importance of each component, describing the specificity and correlations of these elements involved in achieving the precision of interpretation of medical images using DL. The major contribution of this work is primarily to the updated characterisation of the characteristics of the constituent elements of the deep learning process, scientific data, methods of knowledge incorporation, DL models according to the objectives for which they were designed and the presentation of medical applications in accordance with these tasks. Secondly, it describes the specific correlations between the quality, type and volume of data, the deep learning patterns used in the interpretation of diagnostic medical images and their applications in medicine. Finally presents problems and directions of future research. Data quality and volume, annotations and labels, identification and automatic extraction of specific medical terms can help deep learning models perform image analysis tasks. Moreover, the development of models capable of extracting unattended features and easily incorporated into the architecture of DL networks and the development of techniques to search for a certain network architecture according to the objectives set lead to performance in the interpretation of medical images.

Image Color Rendering Based on Hinge-Cross-Entropy GAN in Internet of Medical Things

Computer-aided diagnosis based on image color rendering promotes medical image analysis and doctor-patient communication by highlighting important information of medical diagnosis.To overcome the limitations of the color rendering method based on deep learning,such as poor model stability,poor rendering quality,fuzzy boundaries and crossed color boundaries,we propose a novel hinge-cross-entropy generative adversarial network(HCEGAN).The self-attention mechanism was added and improved to focus on the important information of the image.And the hinge-cross-entropy loss function was used to stabilize the training process of GAN models.In this study,we implement the HCEGAN model for image color rendering based on DIV2K and COCO datasets,and evaluate the results using SSIM and PSNR.The experimental results show that the proposed HCEGAN automatically re-renders images,significantly improves the quality of color rendering and greatly improves the stability of prior GAN models.

Intelligent Electrocardiogram Analysis in Medicine:Data,Methods,and Applications

Electrocardiogram(ECG)is a low-cost,simple,fast,and non-invasive test.It can reflect the heart’s electrical activity and provide valuable diagnostic clues about the health of the entire body.Therefore,ECG has been widely used in various biomedical applications such as arrhythmia detection,disease-specific detection,mortality prediction,and biometric recognition.In recent years,ECG-related studies have been carried out using a variety of publicly available datasets,with many differences in the datasets used,data preprocessing methods,targeted challenges,and modeling and analysis techniques.Here we systematically summarize and analyze the ECGbased automatic analysis methods and applications.Specifically,we first reviewed 22 commonly used ECG public datasets and provided an overview of data preprocessing processes.Then we described some of the most widely used applications of ECG signals and analyzed the advanced methods involved in these applications.Finally,we elucidated some of the challenges in ECG analysis and provided suggestions for further research.

Ensemble Deep Learning with Chimp Optimization Based Medical Data Classification

Eye state classification acts as a vital part of the biomedical sector,for instance,smart home device control,drowsy driving recognition,and so on.The modifications in the cognitive levels can be reflected via transforming the electro-encephalogram(EEG)signals.The deep learning(DL)models automated extract the features and often showcased improved outcomes over the conventional clas-sification model in the recognition processes.This paper presents an Ensemble Deep Learning with Chimp Optimization Algorithm for EEG Eye State Classifi-cation(EDLCOA-ESC).The proposed EDLCOA-ESC technique involves min-max normalization approach as a pre-processing step.Besides,wavelet packet decomposition(WPD)technique is employed for the extraction of useful features from the EEG signals.In addition,an ensemble of deep sparse autoencoder(DSAE)and kernel ridge regression(KRR)models are employed for EEG Eye State classification.Finally,hyperparameters tuning of the DSAE model takes place using COA and thereby boost the classification results to a maximum extent.An extensive range of simulation analysis on the benchmark dataset is car-ried out and the results reported the promising performance of the EDLCOA-ESC technique over the recent approaches with maximum accuracy of 98.50%.

DeepSVDNet:A Deep Learning-Based Approach for Detecting and Classifying Vision-Threatening Diabetic Retinopathy in Retinal Fundus Images

Artificial Intelligence(AI)is being increasingly used for diagnosing Vision-Threatening Diabetic Retinopathy(VTDR),which is a leading cause of visual impairment and blindness worldwide.However,previous automated VTDR detection methods have mainly relied on manual feature extraction and classification,leading to errors.This paper proposes a novel VTDR detection and classification model that combines different models through majority voting.Our proposed methodology involves preprocessing,data augmentation,feature extraction,and classification stages.We use a hybrid convolutional neural network-singular value decomposition(CNN-SVD)model for feature extraction and selection and an improved SVM-RBF with a Decision Tree(DT)and K-Nearest Neighbor(KNN)for classification.We tested our model on the IDRiD dataset and achieved an accuracy of 98.06%,a sensitivity of 83.67%,and a specificity of 100%for DR detection and evaluation tests,respectively.Our proposed approach outperforms baseline techniques and provides a more robust and accurate method for VTDR detection.

ThyroidNet:A Deep Learning Network for Localization and Classification of Thyroid Nodules

Aim:This study aims to establish an artificial intelligence model,ThyroidNet,to diagnose thyroid nodules using deep learning techniques accurately.Methods:A novel method,ThyroidNet,is introduced and evaluated based on deep learning for the localization and classification of thyroid nodules.First,we propose the multitask TransUnet,which combines the TransUnet encoder and decoder with multitask learning.Second,we propose the DualLoss function,tailored to the thyroid nodule localization and classification tasks.It balances the learning of the localization and classification tasks to help improve the model’s generalization ability.Third,we introduce strategies for augmenting the data.Finally,we submit a novel deep learning model,ThyroidNet,to accurately detect thyroid nodules.Results:ThyroidNet was evaluated on private datasets and was comparable to other existing methods,including U-Net and TransUnet.Experimental results show that ThyroidNet outperformed these methods in localizing and classifying thyroid nodules.It achieved improved accuracy of 3.9%and 1.5%,respectively.Conclusion:ThyroidNet significantly improves the clinical diagnosis of thyroid nodules and supports medical image analysis tasks.Future research directions include optimization of the model structure,expansion of the dataset size,reduction of computational complexity and memory requirements,and exploration of additional applications of ThyroidNet in medical image analysis.

Enhancing Pneumonia Detection in Pediatric Chest X-Rays Using CGAN-Augmented Datasets and Lightweight Deep Transfer Learning Models

Pneumonia ranks as a leading cause of mortality, particularly in children aged five and under. Detecting this disease typically requires radiologists to examine chest X-rays and report their findings to physicians, a task susceptible to human error. The application of Deep Transfer Learning (DTL) for the identification of pneumonia through chest X-rays is hindered by a shortage of available images, which has led to less than optimal DTL performance and issues with overfitting. Overfitting is characterized by a model’s learning that is too closely fitted to the training data, reducing its effectiveness on unseen data. The problem of overfitting is especially prevalent in medical image processing due to the high costs and extensive time required for image annotation, as well as the challenge of collecting substantial datasets that also respect patient privacy concerning infectious diseases such as pneumonia. To mitigate these challenges, this paper introduces the use of conditional generative adversarial networks (CGAN) to enrich the pneumonia dataset with 2690 synthesized X-ray images of the minority class, aiming to even out the dataset distribution for improved diagnostic performance. Subsequently, we applied four modified lightweight deep transfer learning models such as Xception, MobileNetV2, MobileNet, and EfficientNetB0. These models have been fine-tuned and evaluated, demonstrating remarkable detection accuracies of 99.26%, 98.23%, 97.06%, and 94.55%, respectively, across fifty epochs. The experimental results validate that the models we have proposed achieve high detection accuracy rates, with the best model reaching up to 99.26% effectiveness, outperforming other models in the diagnosis of pneumonia from X-ray images.

Analysis on Nutritional Risk Screening and Influencing Factors of Hospitalized Patients in Central Urban Area

Rational nutritional support shall be based on nutritional screening and nutritional assessment. This study is aimed to explore nutritional risk screening and its influencing factors of hospitalized patients in central urban area. It is helpful for the early detection of problems in nutritional supports, nutrition management and the implementation of intervention measures, which will contribute a lot to improving the patient＇s poor clinical outcome. A total of three tertiary medical institutions were enrolled in this study. From October 2015 to June 2016, 1202 hospitalized patients aged ≥18 years were enrolled in Nutrition Risk Screening 2002（NRS2002） for nutritional risk screening, including 8 cases who refused to participate, 5 cases of same-day surgery and 5 cases of coma. A single-factor chi-square test was performed on 312 patients with nutritional risk and 872 hospitalized patients without nutritional risk. Logistic regression analysis was performed with univariate analysis（P〈0.05）, to investigate the incidence of nutritional risk and influencing factors. The incidence of nutritional risk was 26.35% in the inpatients, 25.90% in male and 26.84% in female, respectively. The single-factor analysis showed that the age ≥60, sleeping disorder, fasting, intraoperative bleeding, the surgery in recent month, digestive diseases, metabolic diseases and endocrine system diseases had significant effects on nutritional risk（P〈0.05）. Having considered the above-mentioned factors as independent variables and nutritional risk（Y=1, N=0） as dependent variable, logistic regression analysis revealed that the age ≥60, fasting, sleeping disorders, the surgery in recent month and digestive diseases are hazardous factors for nutritional risk. Nutritional risk exists in hospitalized patients in central urban areas. Nutritional risk screening should be conducted for inpatients. Nutritional intervention programs should be formulated in consideration of those influencing factors, which enable to reduce the nutritional risk and to promote the rehabilitation of inpatients.

Transformers in medical image analysis

Transformers have dominated the field of natural language processing and have recently made an impact in the area of computer vision.In the field of medical image analysis,transformers have also been successfully used in to full-stack clinical applications,including image synthesis/reconstruction,registration,segmentation,detection,and diagnosis.This paper aimed to promote awareness of the applications of transformers in medical image analysis.Specifically,we first provided an overview of the core concepts of the attention mechanism built into transformers and other basic components.Second,we reviewed various transformer architectures tailored for medical image applications and discuss their limitations.Within this review,we investigated key challenges including the use of transformers in different learning paradigms,improving model efficiency,and coupling with other techniques.We hope this review would provide a comprehensive picture of transformers to readers with an interest in medical image analysis.

Deep Learning Framework for the Prediction of Childhood Medulloblastoma

This research work develops new and better prognostic markers for predicting Childhood MedulloBlastoma(CMB)using a well-defined deep learning architecture.A deep learning architecture could be designed using ideas from image processing and neural networks to predict CMB using histopathological images.First,a convolution process transforms the histopathological image into deep features that uniquely describe it using different two-dimensional filters of various sizes.A 10-layer deep learning architecture is designed to extract deep features.The introduction of pooling layers in the architecture reduces the feature dimension.The extracted and dimension-reduced deep features from the arrangement of convolution layers and pooling layers are used to classify histopathological images using a neural network classifier.The performance of the CMB classification system is evaluated using 1414(10×magnification)and 1071(100×magnification)augmented histopathological images with five classes of CMB such as desmoplastic,nodular,large cell,classic,and normal.Experimental results show that the average classification accuracy of 99.38%(10×)and 99.07%(100×)is attained by the proposed CNB classification system.

Covid-19 Diagnosis Using a Deep Learning Ensemble Model with Chest X-Ray Images

Covid-19 is a deadly virus that is rapidly spread around the world towards the end of the 2020.The consequences of this virus are quite frightening,especially when accompanied by an underlying disease.The novelty of the virus,the constant emergence of different variants and its rapid spread have a negative impact on the control and treatment process.Although the new test kits provide almost certain results,chest X-rays are extremely important to detect the progression and degree of the disease.In addition to the Covid-19 virus,pneumonia and harmless opacity of the lungs also complicate the diagnosis.Considering the negative results caused by the virus and the treatment costs,the importance of fast and accurate diagnosis is clearly seen.In this context,deep learning methods appear as an extremely popular approach.In this study,a hybrid model design with superior properties of convolutional neural networks is presented to correctly classify the Covid-19 disease.In addition,in order to contribute to the literature,a suitable dataset with balanced case numbers that can be used in all artificial intelligence classification studies is presented.With this ensemble model design,quite remarkable results are obtained for the diagnosis of three and four-class Covid-19.The proposed model can classify normal,pneumonia,and Covid-19 with 92.6%accuracy and 82.6%for normal,pneumonia,Covid-19,and lung opacity.

Recent advances in computerized imaging and its vital roles in liverdisease diagnosis, preoperative planning, and interventional liversurgery: A review

The earliest and most accurate detection of the pathological manifestations of hepatic diseases ensures effective treatments and thus positive prognostic outcomes.In clinical settings,screening and determining the extent of a pathology are prominent factors in preparing remedial agents and administering approp-riate therapeutic procedures.Moreover,in a patient undergoing liver resection,a realistic preoperative simulation of the subject-specific anatomy and physiology also plays a vital part in conducting initial assessments,making surgical decisions during the procedure,and anticipating postoperative results.Conventionally,various medical imaging modalities,e.g.,computed tomography,magnetic resonance imaging,and positron emission tomography,have been employed to assist in these tasks.In fact,several standardized procedures,such as lesion detection and liver segmentation,are also incorporated into prominent commercial software packages.Thus far,most integrated software as a medical device typically involves tedious interactions from the physician,such as manual delineation and empirical adjustments,as per a given patient.With the rapid progress in digital health approaches,especially medical image analysis,a wide range of computer algorithms have been proposed to facilitate those procedures.They include pattern recognition of a liver,its periphery,and lesion,as well as pre-and postoperative simulations.Prior to clinical adoption,however,software must conform to regulatory requirements set by the governing agency,for instance,valid clinical association and analytical and clinical validation.Therefore,this paper provides a detailed account and discussion of the state-of-the-art methods for liver image analyses,visualization,and simulation in the literature.Emphasis is placed upon their concepts,algorithmic classifications,merits,limitations,clinical considerations,and future research trends.

Convolutional neural networks for the diagnosis and prognosis of the coronavirus disease pandemic

A neural network is one of the current trends in deep learning,which is increasingly gaining attention owing to its contribution in transforming the different facets of human life.It also paves a way to approach the current crisis caused by the coronavirus disease(COVID-19)from all scientific directions.Convolutional neural network(CNN),a type of neural network,is extensively applied in the medical field,and is particularly useful in the current COVID-19 pandemic.In this article,we present the application of CNNs for the diagnosis and prognosis of COVID-19 using X-ray and computed tomography(CT)images of COVID-19 patients.The CNN models discussed in this review were mainly developed for the detection,classification,and segmentation of COVID-19 images.The base models used for detection and classification were AlexNet,Visual Geometry Group Network with 16 layers,residual network,DensNet,GoogLeNet,MobileNet,Inception,and extreme Inception.U-Net and voxel-based broad learning network were used for segmentation.Even with limited datasets,these methods proved to be beneficial for efficiently identifying the occurrence of COVID-19.To further validate these observations,we conducted an experimental study using a simple CNN framework for the binary classification of COVID-19 CT images.We achieved an accuracy of 93%with an F1-score of 0.93.Thus,with the availability of improved medical image datasets,it is evident that CNNs are very useful for the efficient diagnosis and prognosis of COVID-19.

Screening of COVID-19 Patients Using Deep Learning and IoT Framework

In March 2020,the World Health Organization declared the coronavirus disease(COVID-19)outbreak as a pandemic due to its uncontrolled global spread.Reverse transcription polymerase chain reaction is a laboratory test that is widely used for the diagnosis of this deadly disease.However,the limited availability of testing kits and qualified staff and the drastically increasing number of cases have hampered massive testing.To handle COVID19 testing problems,we apply the Internet of Things and artificial intelligence to achieve self-adaptive,secure,and fast resource allocation,real-time tracking,remote screening,and patient monitoring.In addition,we implement a cloud platform for efficient spectrum utilization.Thus,we propose a cloudbased intelligent system for remote COVID-19 screening using cognitiveradio-based Internet of Things and deep learning.Specifically,a deep learning technique recognizes radiographic patterns in chest computed tomography(CT)scans.To this end,contrast-limited adaptive histogram equalization is applied to an input CT scan followed by bilateral filtering to enhance the spatial quality.The image quality assessment of the CT scan is performed using the blind/referenceless image spatial quality evaluator.Then,a deep transfer learning model,VGG-16,is trained to diagnose a suspected CT scan as either COVID-19 positive or negative.Experimental results demonstrate that the proposed VGG-16 model outperforms existing COVID-19 screening models regarding accuracy,sensitivity,and specificity.The results obtained from the proposed system can be verified by doctors and sent to remote places through the Internet.

Pseudo Zernike Moment and Deep Stacked Sparse Autoencoder for COVID-19 Diagnosis

(Aim)COVID-19 is an ongoing infectious disease.It has caused more than 107.45 m confirmed cases and 2.35 m deaths till 11/Feb/2021.Traditional computer vision methods have achieved promising results on the automatic smart diagnosis.(Method)This study aims to propose a novel deep learning method that can obtain better performance.We use the pseudo-Zernike moment(PZM),derived from Zernike moment,as the extracted features.Two settings are introducing:(i)image plane over unit circle;and(ii)image plane inside the unit circle.Afterward,we use a deep-stacked sparse autoencoder(DSSAE)as the classifier.Besides,multiple-way data augmentation is chosen to overcome overfitting.The multiple-way data augmentation is based on Gaussian noise,salt-and-pepper noise,speckle noise,horizontal and vertical shear,rotation,Gamma correction,random translation and scaling.(Results)10 runs of 10-fold cross validation shows that our PZM-DSSAE method achieves a sensitivity of 92.06%±1.54%,a specificity of 92.56%±1.06%,a precision of 92.53%±1.03%,and an accuracy of 92.31%±1.08%.Its F1 score,MCC,and FMI arrive at 92.29%±1.10%,84.64%±2.15%,and 92.29%±1.10%,respectively.The AUC of our model is 0.9576.(Conclusion)We demonstrate“image plane over unit circle”can get better results than“image plane inside a unit circle.”Besides,this proposed PZM-DSSAE model is better than eight state-of-the-art approaches.

Rules and Characteristics of TCM Treatment Prescriptions for Patients with Decreased Ovarian Reserve

[Objectives]To analyze the characteristics and rules of traditional Chinese medicine(TCM)in the treatment of decreased ovarian reserve(DOR)in Suzhou TCM Hospital Affiliated to Nanjing University of Chinese Medicine.[Methods]A total of 107 patients with DOR in Suzhou TCM Hospital Affiliated to Nanjing University of Chinese Medicine were selected for sorting,and the usage,classification,nature,taste and meridian homing of the used drugs were statistically analyzed.[Results]A total of 107 patients were included in this stud and a total of 189 flavors of TCM are used.The total frequency of drugs was 4345 times,and a total of 535 prescriptions were issued.The top five frequency of drug use were 2261 times(50.04%)of Paeoniae Radix Alba(Cynanchum otophyllum Schneid.),2037 times(46.88%)of Corni Fructus(Cornus officinalis Sieb.et Zucc.),1818 times(41.84%)of Rehmanniae Radix Praeparata[Rehmannia glutinosa(Gaertn.)Libosch EX Fisch.et Mey.],1610 times(37.05%)of Guiban[Chinemys reevesii(Gray)],and 1303 times(29.99%)of Uncariae Ramulus Cum Uncis(Uncariar hynchophylla Miq.ex Havil.).Kidney deficiency syndrome accounted for the largest proportion at 51.40%,and the use frequency of tonic drugs accounted for the highest at 50.64%;heat-clearing drugs and qi and blood-boosting drugs separately accounted for 19.24%and 17.39%;the top 3 medicinal tastes are sweet(52.02%),pungent(20.71%)and bitter(20.32%);medicinal properties are ranked as warm(60.54%),cold(24.16%),hot(8.72%)and cool(6.49%);the main meridians are spleen,lung,liver,stomach and kidney.[Conclusions]The basic pathogenesis of DOR is deficiency of qi and blood,mainly due to dysfunction of the spleen,lung,liver,liver,stomach and other organs,and kidney deficiency and spleen deficiency are more common.

A Review of Predictive and Contrastive Self-supervised Learning for Medical Images

Over the last decade, supervised deep learning on manually annotated big data has been progressing significantly on computer vision tasks. But, the application of deep learning in medical image analysis is limited by the scarcity of high-quality annotated medical imaging data. An emerging solution is self-supervised learning (SSL), among which contrastive SSL is the most successful approach to rivalling or outperforming supervised learning. This review investigates several state-of-the-art contrastive SSL algorithms originally on natural images as well as their adaptations for medical images, and concludes by discussing recent advances, current limitations, and future directions in applying contrastive SSL in the medical domain.

Information engineering at Oxford

Information engineering mainly focus on application,uncertainty and information for its utility.This lecture discussed several aspects of information engineering research in Oxford,included the areas of mobile robotics,signal processing,real-time computer vision for object tracking,3D reconstruction of space,medical image analysis and artificial intelligence.Then what information engineering really means was discussed and the possibilities for the future of this field was prospected finally.