A gated recurrent unit model to predict Poisson’s ratio using deep learning

Static Poisson’s ratio(vs)is crucial for determining geomechanical properties in petroleum applications,namely sand production.Some models have been used to predict vs;however,the published models were limited to specific data ranges with an average absolute percentage relative error(AAPRE)of more than 10%.The published gated recurrent unit(GRU)models do not consider trend analysis to show physical behaviors.In this study,we aim to develop a GRU model using trend analysis and three inputs for predicting n s based on a broad range of data,n s(value of 0.1627-0.4492),bulk formation density(RHOB)(0.315-2.994 g/mL),compressional time(DTc)(44.43-186.9 μs/ft),and shear time(DTs)(72.9-341.2μ s/ft).The GRU model was evaluated using different approaches,including statistical error an-alyses.The GRU model showed the proper trends,and the model data ranges were wider than previous ones.The GRU model has the largest correlation coefficient(R)of 0.967 and the lowest AAPRE,average percent relative error(APRE),root mean square error(RMSE),and standard deviation(SD)of 3.228%,1.054%,4.389,and 0.013,respectively,compared to other models.The GRU model has a high accuracy for the different datasets:training,validation,testing,and the whole datasets with R and AAPRE values were 0.981 and 2.601%,0.966 and 3.274%,0.967 and 3.228%,and 0.977 and 2.861%,respectively.The group error analyses of all inputs show that the GRU model has less than 5% AAPRE for all input ranges,which is superior to other models that have different AAPRE values of more than 10% at various ranges of inputs.

Differential diagnosis of Crohn’s disease and intestinal tuberculosis based on ATR-FTIR spectroscopy combined with machine learning

BACKGROUND Crohn’s disease(CD)is often misdiagnosed as intestinal tuberculosis(ITB).However,the treatment and prognosis of these two diseases are dramatically different.Therefore,it is important to develop a method to identify CD and ITB with high accuracy,specificity,and speed.AIM To develop a method to identify CD and ITB with high accuracy,specificity,and speed.METHODS A total of 72 paraffin wax-embedded tissue sections were pathologically and clinically diagnosed as CD or ITB.Paraffin wax-embedded tissue sections were attached to a metal coating and measured using attenuated total reflectance fourier transform infrared spectroscopy at mid-infrared wavelengths combined with XGBoost for differential diagnosis.RESULTS The results showed that the paraffin wax-embedded specimens of CD and ITB were significantly different in their spectral signals at 1074 cm^(-1) and 1234 cm^(-1) bands,and the differential diagnosis model based on spectral characteristics combined with machine learning showed accuracy,specificity,and sensitivity of 91.84%,92.59%,and 90.90%,respectively,for the differential diagnosis of CD and ITB.CONCLUSION Information on the mid-infrared region can reveal the different histological components of CD and ITB at the molecular level,and spectral analysis combined with machine learning to establish a diagnostic model is expected to become a new method for the differential diagnosis of CD and ITB.

Decoding degeneration:the implementation of machine learning for clinical detection of neurodegenerative disorders

Machine learning represents a growing subfield of artificial intelligence with much promise in the diagnosis,treatment,and tracking of complex conditions,including neurodegenerative disorders such as Alzheimer’s and Parkinson’s diseases.While no definitive methods of diagnosis or treatment exist for either disease,researchers have implemented machine learning algorithms with neuroimaging and motion-tracking technology to analyze pathologically relevant symptoms and biomarkers.Deep learning algorithms such as neural networks and complex combined architectures have proven capable of tracking disease-linked changes in brain structure and physiology as well as patient motor and cognitive symptoms and responses to treatment.However,such techniques require further development aimed at improving transparency,adaptability,and reproducibility.In this review,we provide an overview of existing neuroimaging technologies and supervised and unsupervised machine learning techniques with their current applications in the context of Alzheimer’s and Parkinson’s diseases.

Detection of Alzheimer’s disease onset using MRI and PET neuroimaging:longitudinal data analysis and machine learning

The scientists are dedicated to studying the detection of Alzheimer’s disease onset to find a cure, or at the very least, medication that can slow the progression of the disease. This article explores the effectiveness of longitudinal data analysis, artificial intelligence, and machine learning approaches based on magnetic resonance imaging and positron emission tomography neuroimaging modalities for progression estimation and the detection of Alzheimer’s disease onset. The significance of feature extraction in highly complex neuroimaging data, identification of vulnerable brain regions, and the determination of the threshold values for plaques, tangles, and neurodegeneration of these regions will extensively be evaluated. Developing automated methods to improve the aforementioned research areas would enable specialists to determine the progression of the disease and find the link between the biomarkers and more accurate detection of Alzheimer’s disease onset.

Comparison and development of machine learning for thalidomideinduced peripheral neuropathy prediction of refractory Crohn’s disease in Chinese population

BACKGROUND Thalidomide is an effective treatment for refractory Crohn’s disease(CD).However,thalidomide-induced peripheral neuropathy(TiPN),which has a large individual variation,is a major cause of treatment failure.TiPN is rarely predictable and recognized,especially in CD.It is necessary to develop a risk model to predict TiPN occurrence.AIM To develop and compare a predictive model of TiPN using machine learning based on comprehensive clinical and genetic variables.METHODS A retrospective cohort of 164 CD patients from January 2016 to June 2022 was used to establish the model.The National Cancer Institute Common Toxicity Criteria Sensory Scale(version 4.0)was used to assess TiPN.With 18 clinical features and 150 genetic variables,five predictive models were established and evaluated by the confusion matrix receiver operating characteristic curve(AUROC),area under the precision-recall curve(AUPRC),specificity,sensitivity(recall rate),precision,accuracy,and F1 score.RESULTS The top-ranking five risk variables associated with TiPN were interleukin-12 rs1353248[P=0.0004,odds ratio(OR):8.983,95%confidence interval(CI):2.497-30.90],dose(mg/d,P=0.002),brainderived neurotrophic factor(BDNF)rs2030324(P=0.001,OR:3.164,95%CI:1.561-6.434),BDNF rs6265(P=0.001,OR:3.150,95%CI:1.546-6.073)and BDNF rs11030104(P=0.001,OR:3.091,95%CI:1.525-5.960).In the training set,gradient boosting decision tree(GBDT),extremely random trees(ET),random forest,logistic regression and extreme gradient boosting(XGBoost)obtained AUROC values>0.90 and AUPRC>0.87.Among these models,XGBoost and GBDT obtained the first two highest AUROC(0.90 and 1),AUPRC(0.98 and 1),accuracy(0.96 and 0.98),precision(0.90 and 0.95),F1 score(0.95 and 0.98),specificity(0.94 and 0.97),and sensitivity(1).In the validation set,XGBoost algorithm exhibited the best predictive performance with the highest specificity(0.857),accuracy(0.818),AUPRC(0.86)and AUROC(0.89).ET and GBDT obtained the highest sensitivity(1)and F1 score(0.8).Overall,compared with other state-of-the-art classifiers such as ET,GBDT and RF,XGBoost algorithm not only showed a more stable performance,but also yielded higher ROC-AUC and PRC-AUC scores,demonstrating its high accuracy in prediction of TiPN occurrence.CONCLUSION The powerful XGBoost algorithm accurately predicts TiPN using 18 clinical features and 14 genetic variables.With the ability to identify high-risk patients using single nucleotide polymorphisms,it offers a feasible option for improving thalidomide efficacy in CD patients.

Alzheimer’s Disease Stage Classification Using a Deep Transfer Learning and Sparse Auto Encoder Method

Alzheimer’s Disease(AD)is a progressive neurological disease.Early diagnosis of this illness using conventional methods is very challenging.Deep Learning(DL)is one of the finest solutions for improving diagnostic procedures’performance and forecast accuracy.The disease’s widespread distribution and elevated mortality rate demonstrate its significance in the older-onset and younger-onset age groups.In light of research investigations,it is vital to consider age as one of the key criteria when choosing the subjects.The younger subjects are more susceptible to the perishable side than the older onset.The proposed investigation concentrated on the younger onset.The research used deep learning models and neuroimages to diagnose and categorize the disease at its early stages automatically.The proposed work is executed in three steps.The 3D input images must first undergo image pre-processing using Weiner filtering and Contrast Limited Adaptive Histogram Equalization(CLAHE)methods.The Transfer Learning(TL)models extract features,which are subsequently compressed using cascaded Auto Encoders(AE).The final phase entails using a Deep Neural Network(DNN)to classify the phases of AD.The model was trained and tested to classify the five stages of AD.The ensemble ResNet-18 and sparse autoencoder with DNN model achieved an accuracy of 98.54%.The method is compared to state-of-the-art approaches to validate its efficacy and performance.

Implicit Continuous User Authentication for Mobile Devices based on Deep Reinforcement Learning

The predominant method for smart phone accessing is confined to methods directing the authentication by means of Point-of-Entry that heavily depend on physiological biometrics like,fingerprint or face.Implicit continuous authentication initiating to be loftier to conventional authentication mechanisms by continuously confirming users’identities on continuing basis and mark the instant at which an illegitimate hacker grasps dominance of the session.However,divergent issues remain unaddressed.This research aims to investigate the power of Deep Reinforcement Learning technique to implicit continuous authentication for mobile devices using a method called,Gaussian Weighted Cauchy Kriging-based Continuous Czekanowski’s(GWCK-CC).First,a Gaussian Weighted Non-local Mean Filter Preprocessing model is applied for reducing the noise pre-sent in the raw input face images.Cauchy Kriging Regression function is employed to reduce the dimensionality.Finally,Continuous Czekanowski’s Clas-sification is utilized for proficient classification between the genuine user and attacker.By this way,the proposed GWCK-CC method achieves accurate authen-tication with minimum error rate and time.Experimental assessment of the pro-posed GWCK-CC method and existing methods are carried out with different factors by using UMDAA-02 Face Dataset.The results confirm that the proposed GWCK-CC method enhances authentication accuracy,by 9%,reduces the authen-tication time,and error rate by 44%,and 43%as compared to the existing methods.

基于思维品质培养的小学英语词汇教学策略探究——以Unit 5 Dinner’s ready Let’s learn板块为例

以改善目前小学英语词汇教学中思维品质培养意识淡薄的问题为切入点,以PEP小学《英语》四年级(上)Unit 5 Dinner’s ready Let’slearn板块为例,探究如何依托主题与英语学习活动观,在词汇教学中培养学生的思维品质。提出教师应增强Let’slearn板块词汇教学的思维引领与进阶的育人作用,助力学生英语学科核心素养的协调发展。

Privacy Preserved Brain Disorder Diagnosis Using Federated Learning

Federated learning has recently attracted significant attention as a cutting-edge technology that enables Artificial Intelligence(AI)algorithms to utilize global learning across the data of numerous individuals while safeguarding user data privacy.Recent advanced healthcare technologies have enabled the early diagnosis of various cognitive ailments like Parkinson’s.Adequate user data is frequently used to train machine learning models for healthcare systems to track the health status of patients.The healthcare industry faces two significant challenges:security and privacy issues and the personalization of cloud-trained AI models.This paper proposes a Deep Neural Network(DNN)based approach embedded in a federated learning framework to detect and diagnose brain disorders.We extracted the data from the database of Kay Elemetrics voice disordered and divided the data into two windows to create training models for two clients,each with different data.To lessen the over-fitting aspect,every client reviewed the outcomes in three rounds.The proposed model identifies brain disorders without jeopardizing privacy and security.The results reveal that the global model achieves an accuracy of 82.82%for detecting brain disorders while preserving privacy.

Xception-Fractalnet:Hybrid Deep Learning Based Multi-Class Classification of Alzheimer’s Disease

Neurological disorders such as Alzheimer’s disease(AD)are very challenging to treat due to their sensitivity,technical challenges during surgery,and high expenses.The complexity of the brain structures makes it difficult to distinguish between the various brain tissues and categorize AD using conventional classification methods.Furthermore,conventional approaches take a lot of time and might not always be precise.Hence,a suitable classification framework with brain imaging may produce more accurate findings for early diagnosis of AD.Therefore in this paper,an effective hybrid Xception and Fractalnet-based deep learning framework are implemented to classify the stages of AD into five classes.Initially,a network based on Unet++is built to segment the tissues of the brain.Then,using the segmented tissue components as input,the Xception-based deep learning technique is employed to extract high-level features.Finally,the optimized Fractalnet framework is used to categorize the disease condition using the acquired characteristics.The proposed strategy is tested on the Alzheimer’s Disease Neuroimaging Initiative(ADNI)dataset that accurately segments brain tissues with a 98.45%of dice similarity coefficient(DSC).Additionally,for themulticlass classification of AD,the suggested technique obtains an accuracy of 99.06%.Moreover,ANOVA statistical analysis is also used to evaluate if the groups are significant or not.The findings show that the suggested model outperforms various stateof-the-art methods in terms of several performance metrics.

Research on Federated Learning Data Sharing Scheme Based on Differential Privacy

To realize data sharing,and to fully use the data value,breaking the data island between institutions to realize data collaboration has become a new sharing mode.This paper proposed a distributed data security sharing scheme based on C/S communication mode,and constructed a federated learning architecture that uses differential privacy technology to protect training parameters.Clients do not need to share local data,and they only need to upload the trained model parameters to achieve data sharing.In the process of training,a distributed parameter update mechanism is introduced.The server is mainly responsible for issuing training commands and parameters,and aggregating the local model parameters uploaded by the clients.The client mainly uses the stochastic gradient descent algorithm for gradient trimming,updates,and transmits the trained model parameters back to the server after differential processing.To test the performance of the scheme,in the application scenario where many medical institutions jointly train the disease detection system,the model is tested from multiple perspectives by taking medical data as an example.From the testing results,we can know that for this specific test dataset,when the parameters are properly configured,the lowest prediction accuracy rate is 90.261%and the highest accuracy rate is up to 94.352.It shows that the performance of the model is good.The results also show that this scheme realizes data sharing while protecting data privacy,completes accurate prediction of diseases,and has a good effect.

Prediction of the Wastewater’s pH Based on Deep Learning Incorporating Sliding Windows

To protect the environment,the discharged sewage’s quality must meet the state’s discharge standards.There are many water quality indicators,and the pH(Potential of Hydrogen)value is one of them.The natural water’s pH value is 6.0–8.5.The sewage treatment plant uses some data in the sewage treatment process to monitor and predict whether wastewater’s pH value will exceed the standard.This paper aims to study the deep learning prediction model of wastewater’s pH.Firstly,the research uses the random forest method to select the data features and then,based on the sliding window,convert the data set into a time series which is the input of the deep learning training model.Secondly,by analyzing and comparing relevant references,this paper believes that the CNN(Convolutional Neural Network)model is better at nonlinear data modeling and constructs a CNN model including the convolution and pooling layers.After alternating the combination of the convolutional layer and pooling layer,all features are integrated into a full-connected neural network.Thirdly,the number of input samples of the CNN model directly affects the prediction effect of the model.Therefore,this paper adopts the sliding window method to study the optimal size.Many experimental results show that the optimal prediction model can be obtained when alternating six convolutional layers and three pooling layers.The last full-connection layer contains two layers and 64 neurons per layer.The sliding window size selects as 12.Finally,the research has carried out data prediction based on the optimal CNN deep learning model.The predicted pH of the sewage is between 7.2 and 8.6 in this paper.The result is applied in the monitoring system platform of the“Intelligent operation and maintenance platform of the reclaimed water plant.”

Rapid, accurate and serotype independent pipeline for in silico epitope mapping of SARS-CoV-2 antigens: a combined machine learning and Chou’s pseudo amino acid composition method

Here,a new integrated machine learning and Chou’s pseudo amino acid composition method has been proposed for in silico epitope mapping of severe acute respiratorysyndrome-like coronavirus antigens.For this,a training dataset including 266 linear B-cell epitopes,1,267 T-cell epitopes and 1,280 non-epitopes were prepared.The epitope sequences were then converted to numerical vectors using Chou’s pseudo amino acid composition method.The vectors were then introduced to the support vector machine,random forest,artificial neural network,and K-nearest neighbor algorithms for the classification process.The algorithm with the highest performance was selected for the epitope mapping procedure.Based on the obtained results,the random forest algorithm was the most accurate classifier with an accuracy of 0.934 followed by K-nearest neighbor,artificial neural network,and support vector machine respectively.Furthermore,the efficacies of predicted epitopes by the trained random forest algorithm were assessed through their antigenicity potential as well as affinity to human B cell receptor and MHC-I/II alleles using the VaxiJen score and molecular docking,respectively.It was also clear that the predicted epitopes especially the B-cell epitopes had high antigenicity potentials and good affinities to the protein targets.According to the results,the suggested method can be considered for developing specific epitope predictor software as well as an accelerator pipeline for designing serotype independent vaccine against the virus.

A Survey into Teachers＇ Roles in Web-based College English Autonomous Learning

The paper, with the backdrop of web-based autonomous learning put forward by the recent college English teaching reform, aims to explore teachers＇ roles in this learning process in students＇ perception through the means of questionnaires and interviews. It further analyzes the possible reasons why students perceive their teachers＇ roles in such a way, in the hope of providing some implications for web-based college English autonomous learning.

改进YOLOX-s的密集垃圾检测方法

针对密集堆放的多种类垃圾检测存在识别率低、定位不够准确和待测目标被误检、漏检问题,提出了一种融合多头自注意力机制改进YOLOX-s的垃圾检测方法。在特征提取网络嵌入SwinTransformer模块,引入基于滑窗操作的多头自注意力机制,使得网络兼顾全局特征信息和重点特征信息,减少误检现象;在预测输出网络中使用可变形卷积,对初始预测框进行精细化处理,提高定位精度;在EIoU损失的基础上引入加权系数,提出加权IoU-EIoU损失,自适应调整训练时不同阶段不同损失的关注程度,进一步加快训练网络的收敛速度。在公开204类垃圾检测数据集中进行测试,结果表明,所提改进算法的平均精度均值分别可达80.5%和92.5%,优于当前流行目标检测算法,且检测速度快,满足实时性需求。

Estimation of Gaussian overlapping nuclear pulse parameters based on a deep learning LSTM model

A long short-term memory(LSTM)neural network has excellent learning ability applicable to time series of nuclear pulse signals.It can accurately estimate parameters associated with amplitude,time,and so on,in digitally shaped nuclear pulse signals—especially signals from overlapping pulses.By learning the mapping relationship between Gaussian overlapping pulses after digital shaping and exponential pulses before shaping,the shaping parameters of the overlapping exponential nuclear pulses can be estimated using the LSTM model.Firstly,the Gaussian overlapping nuclear pulse(ONP)parameters which need to be estimated received Gaussian digital shaping treatment,after superposition by multiple exponential nuclear pulses.Secondly,a dataset containing multiple samples was produced,each containing a sequence of sample values from Gaussian ONP,after digital shaping,and a set of shaping parameters from exponential pulses before digital shaping.Thirdly,the Training Set in the dataset was used to train the LSTM model.From these datasets,the values sampled from the Gaussian ONP were used as the input data for the LSTM model,and the pulse parameters estimated by the current LSTM model were calculated by forward propagation.Next,the loss function was used to calculate the loss value between the network-estimated pulse parameters and the actual pulse parameters.Then,a gradient-based optimization algorithm was applied,to feedback the loss value and the gradient of the loss function to the neural network,to update the weight of the LSTM model,thereby achieving the purpose of training the network.Finally,the sampled value of the Gaussian ONP for which the shaping parameters needed to be estimated was used as the input data for the LSTM model.After this,the LSTM model produced the required nuclear pulse parameter set.In summary,experimental results showed that the proposed method overcame the defect of local convergence encountered in traditional methods and could accurately extract parameters from multiple,severely overlapping Gaussian pulses,to achieve optimal estimation of nuclear pulse parameters in the global sense.These results support the conclusion that this is a good method for estimating nuclear pulse parameters.

An Adaptive Strategy via Reinforcement Learning for the Prisoner＇s Dilemma Game

The iterated prisoner's dilemma(IPD) is an ideal model for analyzing interactions between agents in complex networks. It has attracted wide interest in the development of novel strategies since the success of tit-for-tat in Axelrod's tournament. This paper studies a new adaptive strategy of IPD in different complex networks, where agents can learn and adapt their strategies through reinforcement learning method. A temporal difference learning method is applied for designing the adaptive strategy to optimize the decision making process of the agents. Previous studies indicated that mutual cooperation is hard to emerge in the IPD. Therefore, three examples which based on square lattice network and scale-free network are provided to show two features of the adaptive strategy. First, the mutual cooperation can be achieved by the group with adaptive agents under scale-free network, and once evolution has converged mutual cooperation, it is unlikely to shift. Secondly, the adaptive strategy can earn a better payoff compared with other strategies in the square network. The analytical properties are discussed for verifying evolutionary stability of the adaptive strategy.

基于Asp.net技术E-learning Centre平台的研究与设计

E-Learning是一种全新,便捷和有效的学习模式。它在提高教育教学质量,挖掘教育的发展潜力方面发挥着重要的作用。介绍了E-learning Centre网站平台的相关理论及技术背景,针对平台的功能,提出了使用ASP.NET技术构筑E-learningCentre(电子化学习中心)平台,探讨采用B/S(Browser/Server)架构体系开发E-learning Centre平台的概要设计。

Anderson's Cognitive Theory and Learning Strategy Studies in Second Language Acquisition

Second language acquisition can not be understood without addressing the interaction between language and cognition. Cognitive theory can extend to describe learning strategies as complex cognitive skills. Theoretical developments in Anderson’s production systems cover a broader range of behavior than other theories, including comprehension and production of oral and written texts as well as comprehension, problem solving, and verbal learning.Thus Anderson’s cognitive theory can be served as a rationale for learning strategy studies in second language acquisition.

Novel Newton’s learning algorithm of neural networks

Newton＇s learning algorithm of NN is presented and realized. In theory, the convergence rate of learning algorithm of NN based on Newton＇s method must be faster than BP＇s and other learning algorithms, because the gradient method is linearly convergent while Newton＇s method has second order convergence rate. The fast computing algorithm of Hesse matrix of the cost function of NN is proposed and it is the theory basis of the improvement of Newton＇s learning algorithm. Simulation results show that the convergence rate of Newton＇s learning algorithm is high and apparently faster than the traditional BP method＇s, and the robustness of Newton＇s learning algorithm is also better than BP method＇ s.