A gated recurrent unit model to predict Poisson’s ratio using deep learning

Static Poisson’s ratio(vs)is crucial for determining geomechanical properties in petroleum applications,namely sand production.Some models have been used to predict vs;however,the published models were limited to specific data ranges with an average absolute percentage relative error(AAPRE)of more than 10%.The published gated recurrent unit(GRU)models do not consider trend analysis to show physical behaviors.In this study,we aim to develop a GRU model using trend analysis and three inputs for predicting n s based on a broad range of data,n s(value of 0.1627-0.4492),bulk formation density(RHOB)(0.315-2.994 g/mL),compressional time(DTc)(44.43-186.9 μs/ft),and shear time(DTs)(72.9-341.2μ s/ft).The GRU model was evaluated using different approaches,including statistical error an-alyses.The GRU model showed the proper trends,and the model data ranges were wider than previous ones.The GRU model has the largest correlation coefficient(R)of 0.967 and the lowest AAPRE,average percent relative error(APRE),root mean square error(RMSE),and standard deviation(SD)of 3.228%,1.054%,4.389,and 0.013,respectively,compared to other models.The GRU model has a high accuracy for the different datasets:training,validation,testing,and the whole datasets with R and AAPRE values were 0.981 and 2.601%,0.966 and 3.274%,0.967 and 3.228%,and 0.977 and 2.861%,respectively.The group error analyses of all inputs show that the GRU model has less than 5% AAPRE for all input ranges,which is superior to other models that have different AAPRE values of more than 10% at various ranges of inputs.

Gated Neural Network-Based Unsteady Aerodynamic Modeling for Large Angles of Attack

Modeling of unsteady aerodynamic loads at high angles of attack using a small amount of experimental or simulation data to construct predictive models for unknown states can greatly improve the efficiency of aircraft unsteady aerodynamic design and flight dynamics analysis.In this paper,aiming at the problems of poor generalization of traditional aerodynamic models and intelligent models,an intelligent aerodynamic modeling method based on gated neural units is proposed.The time memory characteristics of the gated neural unit is fully utilized,thus the nonlinear flow field characterization ability of the learning and training process is enhanced,and the generalization ability of the whole prediction model is improved.The prediction and verification of the model are carried out under the maneuvering flight condition of NACA0015 airfoil.The results show that the model has good adaptability.In the interpolation prediction,the maximum prediction error of the lift and drag coefficients and the moment coefficient does not exceed 10%,which can basically represent the variation characteristics of the entire flow field.In the construction of extrapolation models,the training model based on the strong nonlinear data has good accuracy for weak nonlinear prediction.Furthermore,the error is larger,even exceeding 20%,which indicates that the extrapolation and generalization capabilities need to be further optimized by integrating physical models.Compared with the conventional state space equation model,the proposed method can improve the extrapolation accuracy and efficiency by 78%and 60%,respectively,which demonstrates the applied potential of this method in aerodynamic modeling.

Aerial target threat assessment based on gated recurrent unit and self-attention mechanism

Aerial threat assessment is a crucial link in modern air combat, whose result counts a great deal for commanders to make decisions. With the consideration that the existing threat assessment methods have difficulties in dealing with high dimensional time series target data, a threat assessment method based on self-attention mechanism and gated recurrent unit(SAGRU) is proposed. Firstly, a threat feature system including air combat situations and capability features is established. Moreover, a data augmentation process based on fractional Fourier transform(FRFT) is applied to extract more valuable information from time series situation features. Furthermore, aiming to capture key characteristics of battlefield evolution, a bidirectional GRU and SA mechanisms are designed for enhanced features.Subsequently, after the concatenation of the processed air combat situation and capability features, the target threat level will be predicted by fully connected neural layers and the softmax classifier. Finally, in order to validate this model, an air combat dataset generated by a combat simulation system is introduced for model training and testing. The comparison experiments show the proposed model has structural rationality and can perform threat assessment faster and more accurately than the other existing models based on deep learning.

A HybridManufacturing ProcessMonitoringMethod Using Stacked Gated Recurrent Unit and Random Forest

This study proposed a new real-time manufacturing process monitoring method to monitor and detect process shifts in manufacturing operations.Since real-time production process monitoring is critical in today’s smart manufacturing.The more robust the monitoring model,the more reliable a process is to be under control.In the past,many researchers have developed real-time monitoring methods to detect process shifts early.However,thesemethods have limitations in detecting process shifts as quickly as possible and handling various data volumes and varieties.In this paper,a robust monitoring model combining Gated Recurrent Unit(GRU)and Random Forest(RF)with Real-Time Contrast(RTC)called GRU-RF-RTC was proposed to detect process shifts rapidly.The effectiveness of the proposed GRU-RF-RTC model is first evaluated using multivariate normal and nonnormal distribution datasets.Then,to prove the applicability of the proposed model in a realmanufacturing setting,the model was evaluated using real-world normal and non-normal problems.The results demonstrate that the proposed GRU-RF-RTC outperforms other methods in detecting process shifts quickly with the lowest average out-of-control run length(ARL1)in all synthesis and real-world problems under normal and non-normal cases.The experiment results on real-world problems highlight the significance of the proposed GRU-RF-RTC model in modern manufacturing process monitoring applications.The result reveals that the proposed method improves the shift detection capability by 42.14%in normal and 43.64%in gamma distribution problems.

Fake News Detection Based on Cross-Modal Message Aggregation and Gated Fusion Network

Social media has become increasingly significant in modern society,but it has also turned into a breeding ground for the propagation of misleading information,potentially causing a detrimental impact on public opinion and daily life.Compared to pure text content,multmodal content significantly increases the visibility and share ability of posts.This has made the search for efficient modality representations and cross-modal information interaction methods a key focus in the field of multimodal fake news detection.To effectively address the critical challenge of accurately detecting fake news on social media,this paper proposes a fake news detection model based on crossmodal message aggregation and a gated fusion network(MAGF).MAGF first uses BERT to extract cumulative textual feature representations and word-level features,applies Faster Region-based ConvolutionalNeuralNetwork(Faster R-CNN)to obtain image objects,and leverages ResNet-50 and Visual Geometry Group-19(VGG-19)to obtain image region features and global features.The image region features and word-level text features are then projected into a low-dimensional space to calculate a text-image affinity matrix for cross-modal message aggregation.The gated fusion network combines text and image region features to obtain adaptively aggregated features.The interaction matrix is derived through an attention mechanism and further integrated with global image features using a co-attention mechanism to producemultimodal representations.Finally,these fused features are fed into a classifier for news categorization.Experiments were conducted on two public datasets,Twitter and Weibo.Results show that the proposed model achieves accuracy rates of 91.8%and 88.7%on the two datasets,respectively,significantly outperforming traditional unimodal and existing multimodal models.

Radar Quantitative Precipitation Estimation Based on the Gated Recurrent Unit Neural Network and Echo-Top Data

The Gated Recurrent Unit(GRU) neural network has great potential in estimating and predicting a variable. In addition to radar reflectivity(Z), radar echo-top height(ET) is also a good indicator of rainfall rate(R). In this study, we propose a new method, GRU_Z-ET, by introducing Z and ET as two independent variables into the GRU neural network to conduct the quantitative single-polarization radar precipitation estimation. The performance of GRU_Z-ET is compared with that of the other three methods in three heavy rainfall cases in China during 2018, namely, the traditional Z-R relationship(Z=300R1.4), the optimal Z-R relationship(Z=79R1.68) and the GRU neural network with only Z as the independent input variable(GRU_Z). The results indicate that the GRU_Z-ET performs the best, while the traditional Z-R relationship performs the worst. The performances of the rest two methods are similar.To further evaluate the performance of the GRU_Z-ET, 200 rainfall events with 21882 total samples during May–July of 2018 are used for statistical analysis. Results demonstrate that the spatial correlation coefficients, threat scores and probability of detection between the observed and estimated precipitation are the largest for the GRU_Z-ET and the smallest for the traditional Z-R relationship, and the root mean square error is just the opposite. In addition, these statistics of GRU_Z are similar to those of optimal Z-R relationship. Thus, it can be concluded that the performance of the GRU_ZET is the best in the four methods for the quantitative precipitation estimation.

Using Hybrid Penalty and Gated Linear Units to Improve Wasserstein Generative Adversarial Networks for Single-Channel Speech Enhancement

Recently,speech enhancement methods based on Generative Adversarial Networks have achieved good performance in time-domain noisy signals.However,the training of Generative Adversarial Networks has such problems as convergence difficulty,model collapse,etc.In this work,an end-to-end speech enhancement model based on Wasserstein Generative Adversarial Networks is proposed,and some improvements have been made in order to get faster convergence speed and better generated speech quality.Specifically,in the generator coding part,each convolution layer adopts different convolution kernel sizes to conduct convolution operations for obtaining speech coding information from multiple scales;a gated linear unit is introduced to alleviate the vanishing gradient problem with the increase of network depth;the gradient penalty of the discriminator is replaced with spectral normalization to accelerate the convergence rate of themodel;a hybrid penalty termcomposed of L1 regularization and a scale-invariant signal-to-distortion ratio is introduced into the loss function of the generator to improve the quality of generated speech.The experimental results on both TIMIT corpus and Tibetan corpus show that the proposed model improves the speech quality significantly and accelerates the convergence speed of the model.

Stacking Ensemble Learning-Based Convolutional Gated Recurrent Neural Network for Diabetes Miletus

Diabetes mellitus is a metabolic disease in which blood glucose levels rise as a result of pancreatic insulin production failure.It causes hyperglycemia and chronic multiorgan dysfunction,including blindness,renal failure,and cardi-ovascular disease,if left untreated.One of the essential checks that are needed to be performed frequently in Type 1 Diabetes Mellitus is a blood test,this procedure involves extracting blood quite frequently,which leads to subject discomfort increasing the possibility of infection when the procedure is often recurring.Exist-ing methods used for diabetes classification have less classification accuracy and suffer from vanishing gradient problems,to overcome these issues,we proposed stacking ensemble learning-based convolutional gated recurrent neural network(CGRNN)Metamodel algorithm.Our proposed method initially performs outlier detection to remove outlier data,using the Gaussian distribution method,and the Box-cox method is used to correctly order the dataset.After the outliers’detec-tion,the missing values are replaced by the data’s mean rather than their elimina-tion.In the stacking ensemble base model,multiple machine learning algorithms like Naïve Bayes,Bagging with random forest,and Adaboost Decision tree have been employed.CGRNN Meta model uses two hidden layers Long-Short-Time Memory(LSTM)and Gated Recurrent Unit(GRU)to calculate the weight matrix for diabetes prediction.Finally,the calculated weight matrix is passed to the soft-max function in the output layer to produce the diabetes prediction results.By using LSTM-based CG-RNN,the mean square error(MSE)value is 0.016 and the obtained accuracy is 91.33%.

Gated Fusion Based Transformer Model for Crack Detection on Wind Turbine Blade

Harsh working environments and wear between blades and other unit components can easily lead to cracks and damage on wind turbine blades.The cracks on the blades can endanger the shafting of the generator set,the tower and other components,and even cause the tower to collapse.To achieve high-precision wind blade crack detection,this paper proposes a crack fault-detection strategy that integratesGated ResidualNetwork(GRN),a fusionmodule and Transformer.Firstly,GRNcan reduce unnecessary noisy inputs that could negatively impact performancewhile preserving the integrity of feature information.In addition,to gain in-depth information about the characteristics of wind turbine blades,a fusionmodule is suggested to implement the information fusion of wind turbine features.Specifically,each fan feature ismapped to a one-dimensional vector with the same length,and all one-dimensional vectors are concatenated to obtain a two-dimensional vector.And then,in the fusion module,the information fusion of the same characteristic variables in the different channels is realized through the Channel-mixing MLP,and the information fusion of different characteristic variables in the same channel is realized through the ColumnmixingMLP.Finally,the fused feature vector is input into the Transformer for feature learning,which enhances the influence of important feature information and improves the model’s anti-noise ability and classification accuracy.Extensive experimentswere conducted on the wind turbine supervisory control and data acquisition(SCADA)data froma domesticwind field.The results show that compared with other state-of-the-artmodels,including XGBoost,LightGBM,TabNet,etc.,the F1-score of proposed gated fusion based Transformer model can reach 0.9907,which is 0.4%-2.09% higher than the comparedmodels.Thismethod provides amore reliable approach for the condition detection and maintenance of fan blades in wind farms.

Predicting Wavelet-Transformed Stock Prices Using a Vanishing Gradient Resilient Optimized Gated Recurrent Unit with a Time Lag

The development of accurate prediction models continues to be highly beneficial in myriad disciplines. Deep learning models have performed well in stock price prediction and give high accuracy. However, these models are largely affected by the vanishing gradient problem escalated by some activation functions. This study proposes the use of the Vanishing Gradient Resilient Optimized Gated Recurrent Unit (OGRU) model with a scaled mean Approximation Coefficient (AC) time lag which should counter slow convergence, vanishing gradient and large error metrics. This study employed the Rectified Linear Unit (ReLU), Hyperbolic Tangent (Tanh), Sigmoid and Exponential Linear Unit (ELU) activation functions. Real-life datasets including the daily Apple and 5-minute Netflix closing stock prices were used, and they were decomposed using the Stationary Wavelet Transform (SWT). The decomposed series formed a decomposed data model which was compared to an undecomposed data model with similar hyperparameters and different default lags. The Apple daily dataset performed well with a Default_1 lag, using an undecomposed data model and the ReLU, attaining 0.01312, 0.00854 and 3.67 minutes for RMSE, MAE and runtime. The Netflix data performed best with the MeanAC_42 lag, using decomposed data model and the ELU achieving 0.00620, 0.00487 and 3.01 minutes for the same metrics.

Speech Separation Algorithm Using Gated Recurrent Network Based on Microphone Array

Speech separation is an active research topic that plays an important role in numerous applications,such as speaker recognition,hearing pros-thesis,and autonomous robots.Many algorithms have been put forward to improve separation performance.However,speech separation in reverberant noisy environment is still a challenging task.To address this,a novel speech separation algorithm using gate recurrent unit(GRU)network based on microphone array has been proposed in this paper.The main aim of the proposed algorithm is to improve the separation performance and reduce the computational cost.The proposed algorithm extracts the sub-band steered response power-phase transform(SRP-PHAT)weighted by gammatone filter as the speech separation feature due to its discriminative and robust spatial position in formation.Since the GRU net work has the advantage of processing time series data with faster training speed and fewer training parameters,the GRU model is adopted to process the separation featuresof several sequential frames in the same sub-band to estimate the ideal Ratio Masking(IRM).The proposed algorithm decomposes the mixture signals into time-frequency(TF)units using gammatone filter bank in the frequency domain,and the target speech is reconstructed in the frequency domain by masking the mixture signal according to the estimated IRM.The operations of decomposing the mixture signal and reconstructing the target signal are completed in the frequency domain which can reduce the total computational cost.Experimental results demonstrate that the proposed algorithm realizes omnidirectional speech sep-aration in noisy and reverberant environments,provides good performance in terms of speech quality and intelligibility,and has the generalization capacity to reverberate.

Molecular Mechanisms of Cyclic Nucleotide-Gated Ion Channel Gating

Cyclic nucleotide-gated ion channels （CNGs） are distributed most widely in the neuronal cell. Great progress has been made in molecular mechanisms of CNG channel gating in the recent years. Results of many experiments have indicated that the stoichiometry and assembly of CNG channels affect their property and gating. Experiments of CNG mutants and analyses of cys- teine accessibilities show that cyclic nucleotide-binding domains （CNBD） bind cyclic nucleotides and subsequently conformational changes occurred followed by the concerted or cooperative conformational change of all four subunits during CNG gating. In order to provide theoretical assistances for further investigation on CNG channels, especially regarding the disease pathogenesis of ion channels, this paper reviews the latest progress on mechanisms of CNG channels, functions of subunits, processes of subunit assembly, and conformational changes of subunit regions during gating.

New Forward Gated-Diode Technique for Separating Front Gate Interface- from Oxide-Traps Induced by Hot-Carrier-Stress in SOI-NMOSFETs

The front gate interface and oxide traps induced by hot carrier stress in SOI NMOSFETs are studied.Based on a new forward gated diode technique,the R G current originating from the front interface traps is measured,and then the densities of the interface and oxide traps are separated independently.The experimental results show that the hot carrier stress of front channel not only results in the strong generation of the front interface traps,but also in the significant oxide traps.These two kinds of traps have similar characteristic in increasing with the hot carrier stress time.This analysis allows one to obtain a clear physical picture of the effects of the hot carrier stress on the generating of interface and oxide traps,which help to understand the degradation and reliability of the SOI MOSFETs.

Channel Lateral Pocket or Halo Region of NMOSFET Characterized by Interface State R G Current of the Forward Gated Diode

The channel lateral pocket or halo region of NMOSFET characterized by interface state R G current of a forward gated diode has been investigated numerically for the first time.The result of numerical analysis demonstrates that the effective surface doping concentration and the interface state density of the pocket or halo region are interface states R G current peak position dependent and amplitude dependent,respectively.It can be expressed quantitatively according to the device physics knowledge,thus,the direct characterization of the interface state density and the effective surface doping concentration of the pocket or halo becomes very easy.

Research on Night Vision System Based on Range-Gated Imaging

A design of low-light-level night vision system is described,which can image objects selectively in the specific space. The system can selectively image some objects in specific distances,meanwhile ignore those shelters on the way of observation by combining an intensifying charge coupled device(ICCD) with a near infrared laser assisted in vision,whose operation wavelength matches with the photocathode of the image tube,and adopting the gated mode and adjustable time-delay. A semiconductor laser diode of 100 W in peak power is chosen for illumination. The laser and the image tube operate in 150 ns pulse width and 2 kHz repeat frequency. Some images of different objects at the different distances within 100 m can be obtained clearly,and even behind a grove by using a sampling circuit and a delay control device at 100 W in peak power of semiconductor laser diode,150 ns in pulse width of laser and image tube,2 kHz in repeat frequency.

Peculiar Nonlinear Depletion in Double-Layered Gated Si-δ-Doped GaAs

The low-temperature measurement of Hall effect of the two-dimensional electron system in a double-layered gated Si-δ-doped GaAs is presented.A complex peculiar nonlinear dependence of the depletion on gate voltage is observed.The nonlinearity is also explained on the basis of the assumption that the double-capacity model consists of two δ-doped two-dimensional electron layers and a metallic gate,and the experimental result that the electron mobility is linear with the electron density on a log-log scale.

Effect of High-Gate-Voltage Stress on the Reverse Gated-Diode Current in LDD nMOSFET’s

The reverse generation current under high-gate-voltage stress condition in LDD nMOSFET＇s is studied. We find that the generation current peak decreases as the stress time increases. We ascribe this finding to the dominating oxide trapped electrons that reduce the effective drain bias, lowering the maximal generation rate. The density of the effective trapped electrons affecting the effective drain bias is calculated with our model.

Development of gated fiber detectors for laser-induced strong electromagnetic pulse environments

With the development of laser technologies,nuclear reactions can happen in high-temperature plasma environments induced by lasers and have attracted a lot of attention from different physical disciplines.However,studies on nuclear reactions in plasma are still limited by detecting technologies.This is mainly due to the fact that extremely high electromagnetic pulses(EMPs)can also be induced when high-intensity lasers hit targets to induce plasma,and then cause dysfunction of many types of traditional detectors.Therefore,new particle detecting technologies are highly needed.In this paper,we report a recently developed gated fiber detector which can be used in harsh EMP environments.In this prototype detector,scintillating photons are coupled by fiber and then transferred to a gated photomultiplier tube which is located far away from the EMP source and shielded well.With those measures,the EMPs can be avoided which may result that the device has the capability to identify a single event of nuclear reaction products generated in laser-induced plasma from noise EMP backgrounds.This new type of detector can be widely used as a time-of-flight(TOF)detector in high-intensity laser nuclear physics experiments for detecting neutrons,photons,and other charged particles.

Real-time analysis and prediction of shield cutterhead torque using optimized gated recurrent unit neural network

An accurate prediction of earth pressure balance(EPB)shield moving performance is important to ensure the safety tunnel excavation.A hybrid model is developed based on the particle swarm optimization(PSO)and gated recurrent unit(GRU)neural network.PSO is utilized to assign the optimal hyperparameters of GRU neural network.There are mainly four steps:data collection and processing,hybrid model establishment,model performance evaluation and correlation analysis.The developed model provides an alternative to tackle with time-series data of tunnel project.Apart from that,a novel framework about model application is performed to provide guidelines in practice.A tunnel project is utilized to evaluate the performance of proposed hybrid model.Results indicate that geological and construction variables are significant to the model performance.Correlation analysis shows that construction variables(main thrust and foam liquid volume)display the highest correlation with the cutterhead torque(CHT).This work provides a feasible and applicable alternative way to estimate the performance of shield tunneling.

Voltage gated calcium channel antibody-related neurological diseases

Voltage gated calcium channel(VGCC) antibodies are generally associated with Lambert-Eaton myasthenic syndrome. However the presence of this antibody has been associated with paraneoplastic as well as nonparaneoplastic cerebellar degeneration. Most patients with VGCC-antibody-positivity have small cell lung cancer(SCLC). Lambert-Eaton myasthenic syndrome(LEMS)is an autoimmune disease of the presynaptic part of the neuromuscular junction. Its classical clinical triadis proximal muscle weakness, areflexia and autonomic dysfunction. Fifty to sixty percent of LEMS patients have a neoplasia, usually SCLC. The co-occurrence of SCLC and LEMS causes more severe and progressive disease and shorter survival than non-paraneoplastic LEMS. Treatment includes 3,4 diaminopyridine for symptomatic purposes and immunotherapy with prednisolone, azathioprine or intravenous immunoglobulin in patients unresponsive to 3,4 diaminopyridine. Paraneoplastic cerebellar degeneration(PCD) is a syndrome characterized with severe, subacute pancerebellar dysfunction. Serum is positive for VGCC antibody in 41%-44% of patients, usually with the co-occurrence of SCLC. Clinical and electrophysiological features of LEMS are also present in 20%-40% of these patients. Unfortunately, PCD symptoms do not improve with immunotherapy. The role of VGCC antibody in the immunopathogenesis of LEMS is well known whereas its role in PCD is still unclear. All patients presenting with LEMS or PCD must be investigated for SCLC.