Automatic Image Annotation Using Adaptive Convolutional Deep Learning Model

Every day,websites and personal archives create more and more photos.The size of these archives is immeasurable.The comfort of use of these huge digital image gatherings donates to their admiration.However,not all of these folders deliver relevant indexing information.From the outcomes,it is dif-ficult to discover data that the user can be absorbed in.Therefore,in order to determine the significance of the data,it is important to identify the contents in an informative manner.Image annotation can be one of the greatest problematic domains in multimedia research and computer vision.Hence,in this paper,Adap-tive Convolutional Deep Learning Model(ACDLM)is developed for automatic image annotation.Initially,the databases are collected from the open-source system which consists of some labelled images(for training phase)and some unlabeled images{Corel 5 K,MSRC v2}.After that,the images are sent to the pre-processing step such as colour space quantization and texture color class map.The pre-processed images are sent to the segmentation approach for efficient labelling technique using J-image segmentation(JSEG).Thefinal step is an auto-matic annotation using ACDLM which is a combination of Convolutional Neural Network(CNN)and Honey Badger Algorithm(HBA).Based on the proposed classifier,the unlabeled images are labelled.The proposed methodology is imple-mented in MATLAB and performance is evaluated by performance metrics such as accuracy,precision,recall and F1_Measure.With the assistance of the pro-posed methodology,the unlabeled images are labelled.

Hemodynamic Analysis and Diagnosis Based on Multi-Deep Learning Models

This study employs nine distinct deep learning models to categorize 12,444 blood cell images and automatically extract from them relevant information with an accuracy that is beyond that achievable with traditional techniques.The work is intended to improve current methods for the assessment of human health through measurement of the distribution of four types of blood cells,namely,eosinophils,neutrophils,monocytes,and lymphocytes,known for their relationship with human body damage,inflammatory regions,and organ illnesses,in particular,and with the health of the immune system and other hazards,such as cardiovascular disease or infections,more in general.The results of the experiments show that the deep learning models can automatically extract features from the blood cell images and properly classify them with an accuracy of 98%,97%,and 89%,respectively,with regard to the training,verification,and testing of the corresponding datasets.

Utility of a deep learning model and a clinical model for predicting bleeding after endoscopic submucosal dissection in patients with early gastric cancer

BACKGROUND Bleeding is one of the major complications after endoscopic submucosal dissection(ESD)in early gastric cancer(EGC)patients.There are limited studies on estimating the bleeding risk after ESD using an artificial intelligence system.AIM To derivate and verify the performance of the deep learning model and the clinical model for predicting bleeding risk after ESD in EGC patients.METHODS Patients with EGC who underwent ESD between January 2010 and June 2020 at the Samsung Medical Center were enrolled,and post-ESD bleeding(PEB)was investigated retrospectively.We split the entire cohort into a development set(80%)and a validation set(20%).The deep learning and clinical model were built on the development set and tested in the validation set.The performance of the deep learning model and the clinical model were compared using the area under the curve and the stratification of bleeding risk after ESD.RESULTS A total of 5629 patients were included,and PEB occurred in 325 patients.The area under the curve for predicting PEB was 0.71(95%confidence interval:0.63-0.78)in the deep learning model and 0.70(95%confidence interval:0.62-0.77)in the clinical model,without significant difference(P=0.730).The patients expected to the low-(<5%),intermediate-(≥5%,<9%),and high-risk(≥9%)categories were observed with actual bleeding rate of 2.2%,3.9%,and 11.6%,respectively,in the deep learning model;4.0%,8.8%,and 18.2%,respectively,in the clinical model.CONCLUSION A deep learning model can predict and stratify the bleeding risk after ESD in patients with EGC.

Forecasting the western Pacific subtropical high index during typhoon activity using a hybrid deep learning model

Seasonal location and intensity changes in the western Pacific subtropical high(WPSH)are important factors dominating the synoptic weather and the distribution and magnitude of precipitation in the rain belt over East Asia.Therefore,this article delves into the forecast of the western Pacific subtropical high index during typhoon activity by adopting a hybrid deep learning model.Firstly,the predictors,which are the inputs of the model,are analysed based on three characteristics:the first is the statistical discipline of the WPSH index anomalies corresponding to the three types of typhoon paths;the second is the correspondence of distributions between sea surface temperature,850 hPa zonal wind(u),meridional wind(v),and 500 hPa potential height field;and the third is the numerical sensitivity experiment,which reflects the evident impact of variations in the physical field around the typhoon to the WPSH index.Secondly,the model is repeatedly trained through the backward propagation algorithm to predict the WPSH index using 2011–2018 atmospheric variables as the input of the training set.The model predicts the WPSH index after 6 h,24 h,48 h,and 72 h.The validation set using independent data in 2019 is utilized to illustrate the performance.Finally,the model is improved by changing the CNN2D module to the DeCNN module to enhance its ability to predict images.Taking the 2019 typhoon“Lekima”as an example,it shows the promising performance of this model to predict the 500 hPa potential height field.

Stock Prediction Based on Technical Indicators Using Deep Learning Model

Stock market trends forecast is one of the most current topics and a significant research challenge due to its dynamic and unstable nature.The stock data is usually non-stationary,and attributes are non-correlative to each other.Several traditional Stock Technical Indicators(STIs)may incorrectly predict the stockmarket trends.To study the stock market characteristics using STIs and make efficient trading decisions,a robust model is built.This paper aims to build up an Evolutionary Deep Learning Model(EDLM)to identify stock trends’prices by using STIs.The proposed model has implemented the Deep Learning(DL)model to establish the concept of Correlation-Tensor.The analysis of the dataset of three most popular banking organizations obtained from the live stock market based on the National Stock exchange(NSE)-India,a Long Short Term Memory(LSTM)is used.The datasets encompassed the trading days from the 17^(th) of Nov 2008 to the 15^(th) of Nov 2018.This work also conducted exhaustive experiments to study the correlation of various STIs with stock price trends.The model built with an EDLM has shown significant improvements over two benchmark ML models and a deep learning one.The proposed model aids investors in making profitable investment decisions as it presents trend-based forecasting and has achieved a prediction accuracy of 63.59%,56.25%,and 57.95%on the datasets of HDFC,Yes Bank,and SBI,respectively.Results indicate that the proposed EDLA with a combination of STIs can often provide improved results than the other state-of-the-art algorithms.

Historical Arabic Images Classification and Retrieval Using Siamese Deep Learning Model

Classifying the visual features in images to retrieve a specific image is a significant problem within the computer vision field especially when dealing with historical faded colored images.Thus,there were lots of efforts trying to automate the classification operation and retrieve similar images accurately.To reach this goal,we developed a VGG19 deep convolutional neural network to extract the visual features from the images automatically.Then,the distances among the extracted features vectors are measured and a similarity score is generated using a Siamese deep neural network.The Siamese model built and trained at first from scratch but,it didn’t generated high evaluation metrices.Thus,we re-built it from VGG19 pre-trained deep learning model to generate higher evaluation metrices.Afterward,three different distance metrics combined with the Sigmoid activation function are experimented looking for the most accurate method formeasuring the similarities among the retrieved images.Reaching that the highest evaluation parameters generated using the Cosine distance metric.Moreover,the Graphics Processing Unit(GPU)utilized to run the code instead of running it on the Central Processing Unit(CPU).This step optimized the execution further since it expedited both the training and the retrieval time efficiently.After extensive experimentation,we reached satisfactory solution recording 0.98 and 0.99 F-score for the classification and for the retrieval,respectively.

Unified deep learning model for predicting fundus fluorescein angiography image from fundus structure image

The prediction of fundus fluorescein angiography(FFA)images from fundus structural images is a cutting-edge research topic in ophthalmological image processing.Prediction comprises estimating FFA from fundus camera imaging,single-phase FFA from scanning laser ophthalmoscopy(SLO),and three-phase FFA also from SLO.Although many deep learning models are available,a single model can only perform one or two of these prediction tasks.To accomplish three prediction tasks using a unified method,we propose a unified deep learning model for predicting FFA images from fundus structure images using a supervised generative adversarial network.The three prediction tasks are processed as follows:data preparation,network training under FFA supervision,and FFA image prediction from fundus structure images on a test set.By comparing the FFA images predicted by our model,pix2pix,and CycleGAN,we demonstrate the remarkable progress achieved by our proposal.The high performance of our model is validated in terms of the peak signal-to-noise ratio,structural similarity index,and mean squared error.

Extensive identification of landslide boundaries using remote sensing images and deep learning method

The frequent occurrence of extreme weather events has rendered numerous landslides to a global natural disaster issue.It is crucial to rapidly and accurately determine the boundaries of landslides for geohazards evaluation and emergency response.Therefore,the Skip Connection DeepLab neural network(SCDnn),a deep learning model based on 770 optical remote sensing images of landslide,is proposed to improve the accuracy of landslide boundary detection.The SCDnn model is optimized for the over-segmentation issue which occurs in conventional deep learning models when there is a significant degree of similarity between topographical geomorphic features.SCDnn exhibits notable improvements in landslide feature extraction and semantic segmentation by combining an enhanced Atrous Spatial Pyramid Convolutional Block(ASPC)with a coding structure that reduces model complexity.The experimental results demonstrate that SCDnn can identify landslide boundaries in 119 images with MIoU values between 0.8and 0.9;while 52 images with MIoU values exceeding 0.9,which exceeds the identification accuracy of existing techniques.This work can offer a novel technique for the automatic extensive identification of landslide boundaries in remote sensing images in addition to establishing the groundwork for future inve stigations and applications in related domains.

Ensemble Deep Learning Framework for Situational Aspects-Based Annotation and Classification of International Student’s Tweets during COVID-19

As the COVID-19 pandemic swept the globe,social media plat-forms became an essential source of information and communication for many.International students,particularly,turned to Twitter to express their struggles and hardships during this difficult time.To better understand the sentiments and experiences of these international students,we developed the Situational Aspect-Based Annotation and Classification(SABAC)text mining framework.This framework uses a three-layer approach,combining baseline Deep Learning(DL)models with Machine Learning(ML)models as meta-classifiers to accurately predict the sentiments and aspects expressed in tweets from our collected Student-COVID-19 dataset.Using the pro-posed aspect2class annotation algorithm,we labeled bulk unlabeled tweets according to their contained aspect terms.However,we also recognized the challenges of reducing data’s high dimensionality and sparsity to improve performance and annotation on unlabeled datasets.To address this issue,we proposed the Volatile Stopwords Filtering(VSF)technique to reduce sparsity and enhance classifier performance.The resulting Student-COVID Twitter dataset achieved a sophisticated accuracy of 93.21%when using the random forest as a meta-classifier.Through testing on three benchmark datasets,we found that the SABAC ensemble framework performed exceptionally well.Our findings showed that international students during the pandemic faced various issues,including stress,uncertainty,health concerns,financial stress,and difficulties with online classes and returning to school.By analyzing and summarizing these annotated tweets,decision-makers can better understand and address the real-time problems international students face during the ongoing pandemic.

Deep Transfer Learning Approach for Robust Hand Detection

Human hand detection in uncontrolled environments is a challenging visual recognition task due to numerous variations of hand poses and background image clutter.To achieve highly accurate results as well as provide real-time execution,we proposed a deep transfer learning approach over the state-of-the-art deep learning object detector.Our method,denoted as YOLOHANDS,is built on top of the You Only Look Once(YOLO)deep learning architecture,which is modified to adapt to the single class hand detection task.The model transfer is performed by modifying the higher convolutional layers including the last fully connected layer,while initializing lower non-modified layers with the generic pre-trained weights.To address robustness issues,we introduced a comprehensive augmentation procedure over the training image dataset,specifically adapted for the hand detection problem.Experimental evaluation of the proposed method,which is performed on a challenging public dataset,has demonstrated highly accurate results,comparable to the state-of-the-art methods.

Facial Image-Based Autism Detection:A Comparative Study of Deep Neural Network Classifiers

Autism Spectrum Disorder(ASD)is a neurodevelopmental condition characterized by significant challenges in social interaction,communication,and repetitive behaviors.Timely and precise ASD detection is crucial,particularly in regions with limited diagnostic resources like Pakistan.This study aims to conduct an extensive comparative analysis of various machine learning classifiers for ASD detection using facial images to identify an accurate and cost-effective solution tailored to the local context.The research involves experimentation with VGG16 and MobileNet models,exploring different batch sizes,optimizers,and learning rate schedulers.In addition,the“Orange”machine learning tool is employed to evaluate classifier performance and automated image processing capabilities are utilized within the tool.The findings unequivocally establish VGG16 as the most effective classifier with a 5-fold cross-validation approach.Specifically,VGG16,with a batch size of 2 and the Adam optimizer,trained for 100 epochs,achieves a remarkable validation accuracy of 99% and a testing accuracy of 87%.Furthermore,the model achieves an F1 score of 88%,precision of 85%,and recall of 90% on test images.To validate the practical applicability of the VGG16 model with 5-fold cross-validation,the study conducts further testing on a dataset sourced fromautism centers in Pakistan,resulting in an accuracy rate of 85%.This reaffirms the model’s suitability for real-world ASD detection.This research offers valuable insights into classifier performance,emphasizing the potential of machine learning to deliver precise and accessible ASD diagnoses via facial image analysis.

A hybrid CNN-LSTM model for diagnosing rice nutrient levels at the rice panicle initiation stage

Nitrogen(N)and potassium(K)are two key mineral nutrient elements involved in rice growth.Accurate diagnosis of N and K status is very important for the rational application of fertilizers at a specific rice growth stage.Therefore,we propose a hybrid model for diagnosing rice nutrient levels at the early panicle initiation stage(EPIS),which combines a convolutional neural network(CNN)with an attention mechanism and a long short-term memory network(LSTM).The model was validated on a large set of sequential images collected by an unmanned aerial vehicle(UAV)from rice canopies at different growth stages during a two-year experiment.Compared with VGG16,AlexNet,GoogleNet,DenseNet,and inceptionV3,ResNet101 combined with LSTM obtained the highest average accuracy of 83.81%on the dataset of Huanghuazhan(HHZ,an indica cultivar).When tested on the datasets of HHZ and Xiushui 134(XS134,a japonica rice variety)in 2021,the ResNet101-LSTM model enhanced with the squeeze-and-excitation(SE)block achieved the highest accuracies of 85.38 and 88.38%,respectively.Through the cross-dataset method,the average accuracies on the HHZ and XS134 datasets tested in 2022 were 81.25 and 82.50%,respectively,showing a good generalization.Our proposed model works with the dynamic information of different rice growth stages and can efficiently diagnose different rice nutrient status levels at EPIS,which are helpful for making practical decisions regarding rational fertilization treatments at the panicle initiation stage.

Unified Analysis Specific to the Medical Field in the Interpretation of Medical Images through the Use of Deep Learning

Deep learning (DL) has seen an exponential development in recent years, with major impact in many medical fields, especially in the field of medical image. The purpose of the work converges in determining the importance of each component, describing the specificity and correlations of these elements involved in achieving the precision of interpretation of medical images using DL. The major contribution of this work is primarily to the updated characterisation of the characteristics of the constituent elements of the deep learning process, scientific data, methods of knowledge incorporation, DL models according to the objectives for which they were designed and the presentation of medical applications in accordance with these tasks. Secondly, it describes the specific correlations between the quality, type and volume of data, the deep learning patterns used in the interpretation of diagnostic medical images and their applications in medicine. Finally presents problems and directions of future research. Data quality and volume, annotations and labels, identification and automatic extraction of specific medical terms can help deep learning models perform image analysis tasks. Moreover, the development of models capable of extracting unattended features and easily incorporated into the architecture of DL networks and the development of techniques to search for a certain network architecture according to the objectives set lead to performance in the interpretation of medical images.

Short-term inbound rail transit passenger flow prediction based on BILSTM model and influence factor analysis

Accurate and real-time passenger flow prediction of rail transit is an important part of intelligent transportation systems(ITS).According to previous studies,it is found that the prediction effect of a single model is not good for datasets with large changes in passenger flow characteristics and the deep learning model with added influencing factors has better prediction accuracy.In order to provide persuasive passenger flow forecast data for ITS,a deep learning model considering the influencing factors is proposed in this paper.In view of the lack of objective analysis on the selection of influencing factors by predecessors,this paper uses analytic hierarchy processes(AHP)and one-way ANOVA analysis to scientifically select the factor of time characteristics,which classifies and gives weight to the hourly passenger flow through Duncan test.Then,combining the time weight,BILSTM based model considering the hourly travel characteristics factors is proposed.The model performance is verified through the inbound passenger flow of Ningbo rail transit.The proposed model is compared with many current mainstream deep learning algorithms,the effectiveness of the BILSTM model considering influencing factors is validated.Through comparison and analysis with various evaluation indicators and other deep learning models,the results show that the R2 score of the BILSTM model considering influencing factors reaches 0.968,and the MAE value of the BILSTM model without adding influencing factors decreases by 45.61%.

Impact of artificial intelligence in the management of esophageal,gastric and colorectal malignancies

The incidence of gastrointestinal malignancies has increased over the past decade at an alarming rate.Colorectal and gastric cancers are the third and fifth most commonly diagnosed cancers worldwide but are cited as the second and third leading causes of mortality.Early institution of appropriate therapy from timely diagnosis can optimize patient outcomes.Artificial intelligence(AI)-assisted diagnostic,prognostic,and therapeutic tools can assist in expeditious diagnosis,treatment planning/response prediction,and post-surgical prognostication.AI can intercept neoplastic lesions in their primordial stages,accurately flag suspicious and/or inconspicuous lesions with greater accuracy on radiologic,histopathological,and/or endoscopic analyses,and eliminate over-dependence on clinicians.AI-based models have shown to be on par,and sometimes even outperformed experienced gastroenterologists and radiologists.Convolutional neural networks(state-of-the-art deep learning models)are powerful computational models,invaluable to the field of precision oncology.These models not only reliably classify images,but also accurately predict response to chemotherapy,tumor recurrence,metastasis,and survival rates post-treatment.In this systematic review,we analyze the available evidence about the diagnostic,prognostic,and therapeutic utility of artificial intelligence in gastrointestinal oncology.

Diagnosis of Various Skin Cancer Lesions Based on Fine-Tuned ResNet50 Deep Network

With the massive success of deep networks,there have been signi-cant efforts to analyze cancer diseases,especially skin cancer.For this purpose,this work investigates the capability of deep networks in diagnosing a variety of dermoscopic lesion images.This paper aims to develop and ne-tune a deep learning architecture to diagnose different skin cancer grades based on dermatoscopic images.Fine-tuning is a powerful method to obtain enhanced classication results by the customized pre-trained network.Regularization,batch normalization,and hyperparameter optimization are performed for ne-tuning the proposed deep network.The proposed ne-tuned ResNet50 model successfully classied 7-respective classes of dermoscopic lesions using the publicly available HAM10000 dataset.The developed deep model was compared against two powerful models,i.e.,InceptionV3 and VGG16,using the Dice similarity coefcient(DSC)and the area under the curve(AUC).The evaluation results show that the proposed model achieved higher results than some recent and robust models.

Inatorial forecasting method considering macro and micro characteristics of chaotic traffic flow

Traffic flow prediction is an effective strategy to assess traffic conditions and alleviate traffic congestion. Influenced by external non-stationary factors and road network structure, traffic flow sequences have macro spatiotemporal characteristics and micro chaotic characteristics. The key to improving the model prediction accuracy is to fully extract the macro and micro characteristics of traffic flow time sequences. However, traditional prediction model by only considers time features of traffic data, ignoring spatial characteristics and nonlinear characteristics of the data itself, resulting in poor model prediction performance. In view of this, this research proposes an intelligent combination prediction model taking into account the macro and micro features of chaotic traffic data. Firstly, to address the problem of time-consuming and inefficient multivariate phase space reconstruction by iterating nodes one by one, an improved multivariate phase space reconstruction method is proposed by filtering global representative nodes to effectively realize the high-dimensional mapping of chaotic traffic flow. Secondly, to address the problem that the traditional combinatorial model is difficult to adequately learn the macro and micro characteristics of chaotic traffic data, a combination of convolutional neural network(CNN) and convolutional long short-term memory(ConvLSTM) is utilized for capturing nonlinear features of traffic flow more comprehensively. Finally,to overcome the challenge that the combined model performance degrades due to subjective empirical determined network parameters, an improved lightweight particle swarm is proposed for improving prediction accuracy by optimizing model hyperparameters. In this paper, two highway datasets collected by the Caltrans Performance Measurement System(PeMS)are taken as the research objects, and the experimental results from multiple perspectives show that the comprehensive performance of the method proposed in this research is superior to those of the prevalent methods.

Artificial Intelligence Providing a More Optimized Assessment Tool for Comprehensive Geriatric Assessment

With the continuous development of science and technology,artificial intelligence(AI)is coming into our lives and changing our lives.Since China entered the aging society in 2000,the degree of population aging has deepened.Comprehensive geriatric assessment(CGA)is now the accepted gold standard for the care of older people in hospitals.However,some problems limit the clinical application,such as complexity and time consuming.Therefore,by analyzing previous studies,we summarize some existing AI tools in order to find a more optimized assessment tool to complete the entire CGA process.

Detection of Left Ventricular Cavity from Cardiac MRI Images Using Faster R-CNN

The automatic localization of the left ventricle(LV)in short-axis magnetic resonance(MR)images is a required step to process cardiac images using convolutional neural networks for the extraction of a region of interest(ROI).The precise extraction of the LV’s ROI from cardiac MRI images is crucial for detecting heart disorders via cardiac segmentation or registration.Nevertheless,this task appears to be intricate due to the diversities in the size and shape of the LV and the scattering of surrounding tissues across different slices.Thus,this study proposed a region-based convolutional network(Faster R-CNN)for the LV localization from short-axis cardiac MRI images using a region proposal network(RPN)integrated with deep feature classification and regression.Themodel was trained using images with corresponding bounding boxes(labels)around the LV,and various experiments were applied to select the appropriate layers and set the suitable hyper-parameters.The experimental findings showthat the proposed modelwas adequate,with accuracy,precision,recall,and F1 score values of 0.91,0.94,0.95,and 0.95,respectively.This model also allows the cropping of the detected area of LV,which is vital in reducing the computational cost and time during segmentation and classification procedures.Therefore,itwould be an ideal model and clinically applicable for diagnosing cardiac diseases.

Software Defect Prediction Based Ensemble Approach

Software systems have grown significantly and in complexity.As a result of these qualities,preventing software faults is extremely difficult.Software defect prediction(SDP)can assist developers in finding potential bugs and reducing maintenance costs.When it comes to lowering software costs and assuring software quality,SDP plays a critical role in software development.As a result,automatically forecasting the number of errors in software modules is important,and it may assist developers in allocating limited resources more efficiently.Several methods for detecting and addressing such flaws at a low cost have been offered.These approaches,on the other hand,need to be significantly improved in terms of performance.Therefore in this paper,two deep learning(DL)models Multilayer preceptor(MLP)and deep neural network(DNN)are proposed.The proposed approaches combine the newly established Whale optimization algorithm(WOA)with the complementary Firefly algorithm(FA)to establish the emphasized metaheuristic search EMWS algorithm,which selects fewer but closely related representative features.To find the best-implemented classifier in terms of prediction achievement measurement factor,classifiers were applied to five PROMISE repository datasets.When compared to existing methods,the proposed technique for SDP outperforms,with 0.91%for the JM1 dataset,0.98%accuracy for the KC2 dataset,0.91%accuracy for the PC1 dataset,0.93%accuracy for the MC2 dataset,and 0.92%accuracy for KC3.