A hybrid CNN-LSTM model for diagnosing rice nutrient levels at the rice panicle initiation stage

Nitrogen(N)and potassium(K)are two key mineral nutrient elements involved in rice growth.Accurate diagnosis of N and K status is very important for the rational application of fertilizers at a specific rice growth stage.Therefore,we propose a hybrid model for diagnosing rice nutrient levels at the early panicle initiation stage(EPIS),which combines a convolutional neural network(CNN)with an attention mechanism and a long short-term memory network(LSTM).The model was validated on a large set of sequential images collected by an unmanned aerial vehicle(UAV)from rice canopies at different growth stages during a two-year experiment.Compared with VGG16,AlexNet,GoogleNet,DenseNet,and inceptionV3,ResNet101 combined with LSTM obtained the highest average accuracy of 83.81%on the dataset of Huanghuazhan(HHZ,an indica cultivar).When tested on the datasets of HHZ and Xiushui 134(XS134,a japonica rice variety)in 2021,the ResNet101-LSTM model enhanced with the squeeze-and-excitation(SE)block achieved the highest accuracies of 85.38 and 88.38%,respectively.Through the cross-dataset method,the average accuracies on the HHZ and XS134 datasets tested in 2022 were 81.25 and 82.50%,respectively,showing a good generalization.Our proposed model works with the dynamic information of different rice growth stages and can efficiently diagnose different rice nutrient status levels at EPIS,which are helpful for making practical decisions regarding rational fertilization treatments at the panicle initiation stage.

Advancing automated pupillometry:a practical deep learning model utilizing infrared pupil images

AIM:To establish pupil diameter measurement algorithms based on infrared images that can be used in real-world clinical settings.METHODS:A total of 188 patients from outpatient clinic at He Eye Specialist Shenyang Hospital from Spetember to December 2022 were included,and 13470 infrared pupil images were collected for the study.All infrared images for pupil segmentation were labeled using the Labelme software.The computation of pupil diameter is divided into four steps:image pre-processing,pupil identification and localization,pupil segmentation,and diameter calculation.Two major models are used in the computation process:the modified YoloV3 and Deeplabv 3+models,which must be trained beforehand.RESULTS:The test dataset included 1348 infrared pupil images.On the test dataset,the modified YoloV3 model had a detection rate of 99.98% and an average precision(AP)of 0.80 for pupils.The DeeplabV3+model achieved a background intersection over union(IOU)of 99.23%,a pupil IOU of 93.81%,and a mean IOU of 96.52%.The pupil diameters in the test dataset ranged from 20 to 56 pixels,with a mean of 36.06±6.85 pixels.The absolute error in pupil diameters between predicted and actual values ranged from 0 to 7 pixels,with a mean absolute error(MAE)of 1.06±0.96 pixels.CONCLUSION:This study successfully demonstrates a robust infrared image-based pupil diameter measurement algorithm,proven to be highly accurate and reliable for clinical application.

Unified deep learning model for predicting fundus fluorescein angiography image from fundus structure image

The prediction of fundus fluorescein angiography(FFA)images from fundus structural images is a cutting-edge research topic in ophthalmological image processing.Prediction comprises estimating FFA from fundus camera imaging,single-phase FFA from scanning laser ophthalmoscopy(SLO),and three-phase FFA also from SLO.Although many deep learning models are available,a single model can only perform one or two of these prediction tasks.To accomplish three prediction tasks using a unified method,we propose a unified deep learning model for predicting FFA images from fundus structure images using a supervised generative adversarial network.The three prediction tasks are processed as follows:data preparation,network training under FFA supervision,and FFA image prediction from fundus structure images on a test set.By comparing the FFA images predicted by our model,pix2pix,and CycleGAN,we demonstrate the remarkable progress achieved by our proposal.The high performance of our model is validated in terms of the peak signal-to-noise ratio,structural similarity index,and mean squared error.

Facial Image-Based Autism Detection:A Comparative Study of Deep Neural Network Classifiers

Autism Spectrum Disorder(ASD)is a neurodevelopmental condition characterized by significant challenges in social interaction,communication,and repetitive behaviors.Timely and precise ASD detection is crucial,particularly in regions with limited diagnostic resources like Pakistan.This study aims to conduct an extensive comparative analysis of various machine learning classifiers for ASD detection using facial images to identify an accurate and cost-effective solution tailored to the local context.The research involves experimentation with VGG16 and MobileNet models,exploring different batch sizes,optimizers,and learning rate schedulers.In addition,the“Orange”machine learning tool is employed to evaluate classifier performance and automated image processing capabilities are utilized within the tool.The findings unequivocally establish VGG16 as the most effective classifier with a 5-fold cross-validation approach.Specifically,VGG16,with a batch size of 2 and the Adam optimizer,trained for 100 epochs,achieves a remarkable validation accuracy of 99% and a testing accuracy of 87%.Furthermore,the model achieves an F1 score of 88%,precision of 85%,and recall of 90% on test images.To validate the practical applicability of the VGG16 model with 5-fold cross-validation,the study conducts further testing on a dataset sourced fromautism centers in Pakistan,resulting in an accuracy rate of 85%.This reaffirms the model’s suitability for real-world ASD detection.This research offers valuable insights into classifier performance,emphasizing the potential of machine learning to deliver precise and accessible ASD diagnoses via facial image analysis.

A Systematic Review of Computer Vision Techniques for Quality Control in End-of-Line Visual Inspection of Antenna Parts

The rapid evolution of wireless communication technologies has underscored the critical role of antennas in ensuring seamless connectivity.Antenna defects,ranging from manufacturing imperfections to environmental wear,pose significant challenges to the reliability and performance of communication systems.This review paper navigates the landscape of antenna defect detection,emphasizing the need for a nuanced understanding of various defect types and the associated challenges in visual detection.This review paper serves as a valuable resource for researchers,engineers,and practitioners engaged in the design and maintenance of communication systems.The insights presented here pave the way for enhanced reliability in antenna systems through targeted defect detection measures.In this study,a comprehensive literature analysis on computer vision algorithms that are employed in end-of-line visual inspection of antenna parts is presented.The PRISMA principles will be followed throughout the review,and its goals are to provide a summary of recent research,identify relevant computer vision techniques,and evaluate how effective these techniques are in discovering defects during inspections.It contains articles from scholarly journals as well as papers presented at conferences up until June 2023.This research utilized search phrases that were relevant,and papers were chosen based on whether or not they met certain inclusion and exclusion criteria.In this study,several different computer vision approaches,such as feature extraction and defect classification,are broken down and analyzed.Additionally,their applicability and performance are discussed.The review highlights the significance of utilizing a wide variety of datasets and measurement criteria.The findings of this study add to the existing body of knowledge and point researchers in the direction of promising new areas of investigation,such as real-time inspection systems and multispectral imaging.This review,on its whole,offers a complete study of computer vision approaches for quality control in antenna parts.It does so by providing helpful insights and drawing attention to areas that require additional exploration.

Surface Defect Detection and Evaluation Method of Large Wind Turbine Blades Based on an Improved Deeplabv3+Deep Learning Model

The accumulation of defects on wind turbine blade surfaces can lead to irreversible damage,impacting the aero-dynamic performance of the blades.To address the challenge of detecting and quantifying surface defects on wind turbine blades,a blade surface defect detection and quantification method based on an improved Deeplabv3+deep learning model is proposed.Firstly,an improved method for wind turbine blade surface defect detection,utilizing Mobilenetv2 as the backbone feature extraction network,is proposed based on an original Deeplabv3+deep learning model to address the issue of limited robustness.Secondly,through integrating the concept of pre-trained weights from transfer learning and implementing a freeze training strategy,significant improvements have been made to enhance both the training speed and model training accuracy of this deep learning model.Finally,based on segmented blade surface defect images,a method for quantifying blade defects is proposed.This method combines image stitching algorithms to achieve overall quantification and risk assessment of the entire blade.Test results show that the improved Deeplabv3+deep learning model reduces training time by approximately 43.03%compared to the original model,while achieving mAP and MIoU values of 96.87%and 96.93%,respectively.Moreover,it demonstrates robustness in detecting different surface defects on blades across different back-grounds.The application of a blade surface defect quantification method enables the precise quantification of dif-ferent defects and facilitates the assessment of risk levels associated with defect measurements across the entire blade.This method enables non-contact,long-distance,high-precision detection and quantification of surface defects on the blades,providing a reference for assessing surface defects on wind turbine blades.

Extensive identification of landslide boundaries using remote sensing images and deep learning method

The frequent occurrence of extreme weather events has rendered numerous landslides to a global natural disaster issue.It is crucial to rapidly and accurately determine the boundaries of landslides for geohazards evaluation and emergency response.Therefore,the Skip Connection DeepLab neural network(SCDnn),a deep learning model based on 770 optical remote sensing images of landslide,is proposed to improve the accuracy of landslide boundary detection.The SCDnn model is optimized for the over-segmentation issue which occurs in conventional deep learning models when there is a significant degree of similarity between topographical geomorphic features.SCDnn exhibits notable improvements in landslide feature extraction and semantic segmentation by combining an enhanced Atrous Spatial Pyramid Convolutional Block(ASPC)with a coding structure that reduces model complexity.The experimental results demonstrate that SCDnn can identify landslide boundaries in 119 images with MIoU values between 0.8and 0.9;while 52 images with MIoU values exceeding 0.9,which exceeds the identification accuracy of existing techniques.This work can offer a novel technique for the automatic extensive identification of landslide boundaries in remote sensing images in addition to establishing the groundwork for future inve stigations and applications in related domains.

Mesh representation matters:investigating the influence of different mesh features on perceptual and spatial fidelity of deep 3D morphable models

Background Deep 3D morphable models(deep 3DMMs)play an essential role in computer vision.They are used in facial synthesis,compression,reconstruction and animation,avatar creation,virtual try-on,facial recognition systems and medical imaging.These applications require high spatial and perceptual quality of synthesised meshes.Despite their significance,these models have not been compared with different mesh representations and evaluated jointly with point-wise distance and perceptual metrics.Methods We compare the influence of different mesh representation features to various deep 3DMMs on spatial and perceptual fidelity of the reconstructed meshes.This paper proves the hypothesis that building deep 3DMMs from meshes represented with global representations leads to lower spatial reconstruction error measured with L_(1) and L_(2) norm metrics and underperforms on perceptual metrics.In contrast,using differential mesh representations which describe differential surface properties yields lower perceptual FMPD and DAME and higher spatial fidelity error.The influence of mesh feature normalisation and standardisation is also compared and analysed from perceptual and spatial fidelity perspectives.Results The results presented in this paper provide guidance in selecting mesh representations to build deep 3DMMs accordingly to spatial and perceptual quality objectives and propose combinations of mesh representations and deep 3DMMs which improve either perceptual or spatial fidelity of existing methods.

Impact of artificial intelligence in the management of esophageal,gastric and colorectal malignancies

The incidence of gastrointestinal malignancies has increased over the past decade at an alarming rate.Colorectal and gastric cancers are the third and fifth most commonly diagnosed cancers worldwide but are cited as the second and third leading causes of mortality.Early institution of appropriate therapy from timely diagnosis can optimize patient outcomes.Artificial intelligence(AI)-assisted diagnostic,prognostic,and therapeutic tools can assist in expeditious diagnosis,treatment planning/response prediction,and post-surgical prognostication.AI can intercept neoplastic lesions in their primordial stages,accurately flag suspicious and/or inconspicuous lesions with greater accuracy on radiologic,histopathological,and/or endoscopic analyses,and eliminate over-dependence on clinicians.AI-based models have shown to be on par,and sometimes even outperformed experienced gastroenterologists and radiologists.Convolutional neural networks(state-of-the-art deep learning models)are powerful computational models,invaluable to the field of precision oncology.These models not only reliably classify images,but also accurately predict response to chemotherapy,tumor recurrence,metastasis,and survival rates post-treatment.In this systematic review,we analyze the available evidence about the diagnostic,prognostic,and therapeutic utility of artificial intelligence in gastrointestinal oncology.

Deep learning-based activity recognition and fine motor identification using 2D skeletons of cynomolgus monkeys

Video-based action recognition is becoming a vital tool in clinical research and neuroscientific study for disorder detection and prediction.However,action recognition currently used in non-human primate(NHP)research relies heavily on intense manual labor and lacks standardized assessment.In this work,we established two standard benchmark datasets of NHPs in the laboratory:Monkeyin Lab(Mi L),which includes 13 categories of actions and postures,and MiL2D,which includes sequences of two-dimensional(2D)skeleton features.Furthermore,based on recent methodological advances in deep learning and skeleton visualization,we introduced the Monkey Monitor Kit(Mon Kit)toolbox for automatic action recognition,posture estimation,and identification of fine motor activity in monkeys.Using the datasets and Mon Kit,we evaluated the daily behaviors of wild-type cynomolgus monkeys within their home cages and experimental environments and compared these observations with the behaviors exhibited by cynomolgus monkeys possessing mutations in the MECP2 gene as a disease model of Rett syndrome(RTT).Mon Kit was used to assess motor function,stereotyped behaviors,and depressive phenotypes,with the outcomes compared with human manual detection.Mon Kit established consistent criteria for identifying behavior in NHPs with high accuracy and efficiency,thus providing a novel and comprehensive tool for assessing phenotypic behavior in monkeys.

Inatorial forecasting method considering macro and micro characteristics of chaotic traffic flow

Traffic flow prediction is an effective strategy to assess traffic conditions and alleviate traffic congestion. Influenced by external non-stationary factors and road network structure, traffic flow sequences have macro spatiotemporal characteristics and micro chaotic characteristics. The key to improving the model prediction accuracy is to fully extract the macro and micro characteristics of traffic flow time sequences. However, traditional prediction model by only considers time features of traffic data, ignoring spatial characteristics and nonlinear characteristics of the data itself, resulting in poor model prediction performance. In view of this, this research proposes an intelligent combination prediction model taking into account the macro and micro features of chaotic traffic data. Firstly, to address the problem of time-consuming and inefficient multivariate phase space reconstruction by iterating nodes one by one, an improved multivariate phase space reconstruction method is proposed by filtering global representative nodes to effectively realize the high-dimensional mapping of chaotic traffic flow. Secondly, to address the problem that the traditional combinatorial model is difficult to adequately learn the macro and micro characteristics of chaotic traffic data, a combination of convolutional neural network(CNN) and convolutional long short-term memory(ConvLSTM) is utilized for capturing nonlinear features of traffic flow more comprehensively. Finally,to overcome the challenge that the combined model performance degrades due to subjective empirical determined network parameters, an improved lightweight particle swarm is proposed for improving prediction accuracy by optimizing model hyperparameters. In this paper, two highway datasets collected by the Caltrans Performance Measurement System(PeMS)are taken as the research objects, and the experimental results from multiple perspectives show that the comprehensive performance of the method proposed in this research is superior to those of the prevalent methods.

Hemodynamic Analysis and Diagnosis Based on Multi-Deep Learning Models

This study employs nine distinct deep learning models to categorize 12,444 blood cell images and automatically extract from them relevant information with an accuracy that is beyond that achievable with traditional techniques.The work is intended to improve current methods for the assessment of human health through measurement of the distribution of four types of blood cells,namely,eosinophils,neutrophils,monocytes,and lymphocytes,known for their relationship with human body damage,inflammatory regions,and organ illnesses,in particular,and with the health of the immune system and other hazards,such as cardiovascular disease or infections,more in general.The results of the experiments show that the deep learning models can automatically extract features from the blood cell images and properly classify them with an accuracy of 98%,97%,and 89%,respectively,with regard to the training,verification,and testing of the corresponding datasets.

Deep Transfer Learning Approach for Robust Hand Detection

Human hand detection in uncontrolled environments is a challenging visual recognition task due to numerous variations of hand poses and background image clutter.To achieve highly accurate results as well as provide real-time execution,we proposed a deep transfer learning approach over the state-of-the-art deep learning object detector.Our method,denoted as YOLOHANDS,is built on top of the You Only Look Once(YOLO)deep learning architecture,which is modified to adapt to the single class hand detection task.The model transfer is performed by modifying the higher convolutional layers including the last fully connected layer,while initializing lower non-modified layers with the generic pre-trained weights.To address robustness issues,we introduced a comprehensive augmentation procedure over the training image dataset,specifically adapted for the hand detection problem.Experimental evaluation of the proposed method,which is performed on a challenging public dataset,has demonstrated highly accurate results,comparable to the state-of-the-art methods.

Detection of Left Ventricular Cavity from Cardiac MRI Images Using Faster R-CNN

The automatic localization of the left ventricle(LV)in short-axis magnetic resonance(MR)images is a required step to process cardiac images using convolutional neural networks for the extraction of a region of interest(ROI).The precise extraction of the LV’s ROI from cardiac MRI images is crucial for detecting heart disorders via cardiac segmentation or registration.Nevertheless,this task appears to be intricate due to the diversities in the size and shape of the LV and the scattering of surrounding tissues across different slices.Thus,this study proposed a region-based convolutional network(Faster R-CNN)for the LV localization from short-axis cardiac MRI images using a region proposal network(RPN)integrated with deep feature classification and regression.Themodel was trained using images with corresponding bounding boxes(labels)around the LV,and various experiments were applied to select the appropriate layers and set the suitable hyper-parameters.The experimental findings showthat the proposed modelwas adequate,with accuracy,precision,recall,and F1 score values of 0.91,0.94,0.95,and 0.95,respectively.This model also allows the cropping of the detected area of LV,which is vital in reducing the computational cost and time during segmentation and classification procedures.Therefore,itwould be an ideal model and clinically applicable for diagnosing cardiac diseases.

Software Defect Prediction Based Ensemble Approach

Software systems have grown significantly and in complexity.As a result of these qualities,preventing software faults is extremely difficult.Software defect prediction(SDP)can assist developers in finding potential bugs and reducing maintenance costs.When it comes to lowering software costs and assuring software quality,SDP plays a critical role in software development.As a result,automatically forecasting the number of errors in software modules is important,and it may assist developers in allocating limited resources more efficiently.Several methods for detecting and addressing such flaws at a low cost have been offered.These approaches,on the other hand,need to be significantly improved in terms of performance.Therefore in this paper,two deep learning(DL)models Multilayer preceptor(MLP)and deep neural network(DNN)are proposed.The proposed approaches combine the newly established Whale optimization algorithm(WOA)with the complementary Firefly algorithm(FA)to establish the emphasized metaheuristic search EMWS algorithm,which selects fewer but closely related representative features.To find the best-implemented classifier in terms of prediction achievement measurement factor,classifiers were applied to five PROMISE repository datasets.When compared to existing methods,the proposed technique for SDP outperforms,with 0.91%for the JM1 dataset,0.98%accuracy for the KC2 dataset,0.91%accuracy for the PC1 dataset,0.93%accuracy for the MC2 dataset,and 0.92%accuracy for KC3.

Ensemble Deep Learning Framework for Situational Aspects-Based Annotation and Classification of International Student’s Tweets during COVID-19

As the COVID-19 pandemic swept the globe,social media plat-forms became an essential source of information and communication for many.International students,particularly,turned to Twitter to express their struggles and hardships during this difficult time.To better understand the sentiments and experiences of these international students,we developed the Situational Aspect-Based Annotation and Classification(SABAC)text mining framework.This framework uses a three-layer approach,combining baseline Deep Learning(DL)models with Machine Learning(ML)models as meta-classifiers to accurately predict the sentiments and aspects expressed in tweets from our collected Student-COVID-19 dataset.Using the pro-posed aspect2class annotation algorithm,we labeled bulk unlabeled tweets according to their contained aspect terms.However,we also recognized the challenges of reducing data’s high dimensionality and sparsity to improve performance and annotation on unlabeled datasets.To address this issue,we proposed the Volatile Stopwords Filtering(VSF)technique to reduce sparsity and enhance classifier performance.The resulting Student-COVID Twitter dataset achieved a sophisticated accuracy of 93.21%when using the random forest as a meta-classifier.Through testing on three benchmark datasets,we found that the SABAC ensemble framework performed exceptionally well.Our findings showed that international students during the pandemic faced various issues,including stress,uncertainty,health concerns,financial stress,and difficulties with online classes and returning to school.By analyzing and summarizing these annotated tweets,decision-makers can better understand and address the real-time problems international students face during the ongoing pandemic.

Automatic Image Annotation Using Adaptive Convolutional Deep Learning Model

Every day,websites and personal archives create more and more photos.The size of these archives is immeasurable.The comfort of use of these huge digital image gatherings donates to their admiration.However,not all of these folders deliver relevant indexing information.From the outcomes,it is dif-ficult to discover data that the user can be absorbed in.Therefore,in order to determine the significance of the data,it is important to identify the contents in an informative manner.Image annotation can be one of the greatest problematic domains in multimedia research and computer vision.Hence,in this paper,Adap-tive Convolutional Deep Learning Model(ACDLM)is developed for automatic image annotation.Initially,the databases are collected from the open-source system which consists of some labelled images(for training phase)and some unlabeled images{Corel 5 K,MSRC v2}.After that,the images are sent to the pre-processing step such as colour space quantization and texture color class map.The pre-processed images are sent to the segmentation approach for efficient labelling technique using J-image segmentation(JSEG).Thefinal step is an auto-matic annotation using ACDLM which is a combination of Convolutional Neural Network(CNN)and Honey Badger Algorithm(HBA).Based on the proposed classifier,the unlabeled images are labelled.The proposed methodology is imple-mented in MATLAB and performance is evaluated by performance metrics such as accuracy,precision,recall and F1_Measure.With the assistance of the pro-posed methodology,the unlabeled images are labelled.

Artificial Intelligence Providing a More Optimized Assessment Tool for Comprehensive Geriatric Assessment

With the continuous development of science and technology,artificial intelligence(AI)is coming into our lives and changing our lives.Since China entered the aging society in 2000,the degree of population aging has deepened.Comprehensive geriatric assessment(CGA)is now the accepted gold standard for the care of older people in hospitals.However,some problems limit the clinical application,such as complexity and time consuming.Therefore,by analyzing previous studies,we summarize some existing AI tools in order to find a more optimized assessment tool to complete the entire CGA process.

Research on Fall Detection System Based on Commercial Wi-Fi Devices

Falls are a major cause of disability and even death in the elderly,and fall detection can effectively reduce the damage.Compared with cameras and wearable sensors,Wi-Fi devices can protect user privacy and are inexpensive and easy to deploy.Wi-Fi devices sense user activity by analyzing the channel state information(CSI)of the received signal,which makes fall detection possible.We propose a fall detection system based on commercial Wi-Fi devices which achieves good performance.In the feature extraction stage,we select the discrete wavelet transform(DWT)spectrum as the feature for activity classification,which can balance the temporal and spatial resolution.In the feature classification stage,we design a deep learning model based on convolutional neural networks,which has better performance compared with other traditional machine learning models.Experimental results show our work achieves a false alarm rate of 4.8%and a missed alarm rate of 1.9%.

Multi Head Deep Neural Network Prediction Methodology for High-Risk Cardiovascular Disease on Diabetes Mellitus

Major chronic diseases such as Cardiovascular Disease(CVD),diabetes,and cancer impose a significant burden on people and healthcare systems around the globe.Recently,Deep Learning(DL)has shown great potential for the development of intelligentmobile Health(mHealth)interventions for chronic diseases that could revolutionize the delivery of health care anytime,anywhere.The aimof this study is to present a systematic review of studies that have used DL based on mHealth data for the diagnosis,prognosis,management,and treatment of major chronic diseases and advance our understanding of the progress made in this rapidly developing field.Type 2 Diabetes Mellitus(T2DMs)is a regular chronic disorder that is caused by the secretion of insulin,which leads to serious death-related issues and the most complicated ones.Coronary Heart Disease(CHD)is the most frequent issue related to T2DM patients.The major concern is recognizing the high possibility of CHD complications,yet the model is not available to identify it.This work introduces a deep learning technique that can predict heart disease effectively using a hybrid model,which integrates DNNs(Deep Neural Networks)with a Multi-Head Attention Model called MADNN.The scheme canbedesignedtoautomatically learnthe best-quality features fromElectronic Health Records(EHRs),and effectively combine heterogeneous and time-sequencedmedical data for predicting the risk of CVD.The analysis is done using the Kaggle dataset.The outcomes prove that the MADNN has improved accuracy by about 95%and indicates the precise accuracy is higher for the disease compared with SVM,CNN and ANN.