Effects of data smoothing and recurrent neural network(RNN)algorithms for real-time forecasting of tunnel boring machine(TBM)performance

Tunnel boring machines(TBMs)have been widely utilised in tunnel construction due to their high efficiency and reliability.Accurately predicting TBM performance can improve project time management,cost control,and risk management.This study aims to use deep learning to develop real-time models for predicting the penetration rate(PR).The models are built using data from the Changsha metro project,and their performances are evaluated using unseen data from the Zhengzhou Metro project.In one-step forecast,the predicted penetration rate follows the trend of the measured penetration rate in both training and testing.The autoregressive integrated moving average(ARIMA)model is compared with the recurrent neural network(RNN)model.The results show that univariate models,which only consider historical penetration rate itself,perform better than multivariate models that take into account multiple geological and operational parameters(GEO and OP).Next,an RNN variant combining time series of penetration rate with the last-step geological and operational parameters is developed,and it performs better than other models.A sensitivity analysis shows that the penetration rate is the most important parameter,while other parameters have a smaller impact on time series forecasting.It is also found that smoothed data are easier to predict with high accuracy.Nevertheless,over-simplified data can lose real characteristics in time series.In conclusion,the RNN variant can accurately predict the next-step penetration rate,and data smoothing is crucial in time series forecasting.This study provides practical guidance for TBM performance forecasting in practical engineering.

FOUR-PARAMETER AUTOMATIC TRANSMISSION TECHNOLOGY FOR CONSTRUCTION VEHICLE BASED ON ELMAN RECURSIVE NEURAL NETWORK

From the viewpoint of energy saving and improving transmission efficiency, the ZL50E wheel loader is taken as the study object. And the system model is analyzed based on the transmission system of the construction vehicle. A new four-parameter shift schedule is presented, which can keep the torque converter working in the high efficiency area. The control algorithm based on the Elman recursive neural network is applied, and four-parameter control system is developed which is based on industrial computer. The system is used to collect data accurately and control 4D180 power-shift gearbox of ZL50E wheel loader shift timely. An experiment is done on automatic transmission test-bed, and the result indicates that the control system could reliably and safely work and improve the efficiency of hydraulic torque converter. Four-parameter shift strategy that takes into account the power consuming of the working pump has important operating significance and reflects the actual working status of construction vehicle.

Remaining Useful Life Prediction for a Roller in a Hot Strip Mill Based on Deep Recurrent Neural Networks

Accurate estimation of the remaining useful life(RUL)and health state for rollers is of great significance to hot rolling production.It can provide decision support for roller management so as to improve the productivity of the hot rolling process.In addition,the RUL prediction for rollers is helpful in transitioning from the current regular maintenance strategy to conditional-based maintenance.Therefore,a new method that can extract coarse-grained and fine-grained features from batch data to predict the RUL of the rollers is proposed in this paper.Firstly,a new deep learning network architecture based on recurrent neural networks that can make full use of the extracted coarsegrained fine-grained features to estimate the heath indicator(HI)is developed,where the HI is able to indicate the health state of the roller.Following that,a state-space model is constructed to describe the HI,and the probabilistic distribution of RUL can be estimated by extrapolating the HI degradation model to a predefined failure threshold.Finally,application to a hot strip mill is given to verify the effectiveness of the proposed methods using data collected from an industrial site,and the relatively low RMSE and MAE values demonstrate its advantages compared with some other popular deep learning methods.

New Stability Criteria for Recurrent Neural Networks with a Time-varying Delay

This paper deals with the stability of static recurrent neural networks （RNNs） with a time-varying delay. An augmented Lyapunov-Krasovskii functional is employed, in which some useful terms are included. Furthermore, the relationship among the timevarying delay, its upper bound and their difierence, is taken into account, and novel bounding techniques for 1- τ（t） are employed. As a result, without ignoring any useful term in the derivative of the Lyapunov-Krasovskii functional, the resulting delay-dependent criteria show less conservative than the existing ones. Finally, a numerical example is given to demonstrate the effectiveness of the proposed methods.

Recursive recurrent neural network:A novel model for manipulator control with different levels of physical constraints

Manipulators actuate joints to let end effectors to perform precise path tracking tasks.Recurrent neural network which is described by dynamic models with parallel processing capability,is a powerful tool for kinematic control of manipulators.Due to physical limitations and actuation saturation of manipulator joints,the involvement of joint constraints for kinematic control of manipulators is essential and critical.However,current existing manipulator control methods based on recurrent neural networks mainly handle with limited levels of joint angular constraints,and to the best of our knowledge,methods for kinematic control of manipulators with higher order joint constraints based on recurrent neural networks are not yet reported.In this study,for the first time,a novel recursive recurrent network model is proposed to solve the kinematic control issue for manipulators with different levels of physical constraints,and the proposed recursive recurrent neural network can be formulated as a new manifold system to ensure control solution within all of the joint constraints in different orders.The theoretical analysis shows the stability and the purposed recursive recurrent neural network and its convergence to solution.Simulation results further demonstrate the effectiveness of the proposed method in end‐effector path tracking control under different levels of joint constraints based on the Kuka manipulator system.Comparisons with other methods such as the pseudoinverse‐based method and conventional recurrent neural network method substantiate the superiority of the proposed method.

基于RF-RNN模型的DNS隐蔽信道检测方法

为提高检测隐蔽信道的灵敏度,提出一种基于随机森林(Random Forest,RF)和循环神经网络(Recurrent Neural Network,RNN)的域名系统(Domain Name System,DNS)隐蔽信道检测方法。该方法采用域名检测作为主要手段,使用RF模型对域名进行分类,通过深度学习方法挖掘更高阶的特征表示。实验结果表明,与单一模型相比,该方法在检测准确性和健壮性方面均取得了显著提升。

Robust exponential stability analysis of a larger class of discrete-time recurrent neural networks

The robust exponential stability of a larger class of discrete-time recurrent neural networks (RNNs) is explored in this paper. A novel neural network model, named standard neural network model (SNNM), is introduced to provide a general framework for stability analysis of RNNs. Most of the existing RNNs can be transformed into SNNMs to be analyzed in a unified way. Applying Lyapunov stability theory method and S-Procedure technique, two useful criteria of robust exponential stability for the discrete-time SNNMs are derived. The conditions presented are formulated as linear matrix inequalities (LMIs) to be easily solved using existing efficient convex optimization techniques. An example is presented to demonstrate the transformation procedure and the effectiveness of the results.

Hyperparameter Tuning for Deep Neural Networks Based Optimization Algorithm

For training the present Neural Network(NN)models,the standard technique is to utilize decaying Learning Rates(LR).While the majority of these techniques commence with a large LR,they will decay multiple times over time.Decaying has been proved to enhance generalization as well as optimization.Other parameters,such as the network’s size,the number of hidden layers,drop-outs to avoid overfitting,batch size,and so on,are solely based on heuristics.This work has proposed Adaptive Teaching Learning Based(ATLB)Heuristic to identify the optimal hyperparameters for diverse networks.Here we consider three architec-tures Recurrent Neural Networks(RNN),Long Short Term Memory(LSTM),Bidirectional Long Short Term Memory(BiLSTM)of Deep Neural Networks for classification.The evaluation of the proposed ATLB is done through the various learning rate schedulers Cyclical Learning Rate(CLR),Hyperbolic Tangent Decay(HTD),and Toggle between Hyperbolic Tangent Decay and Triangular mode with Restarts(T-HTR)techniques.Experimental results have shown the performance improvement on the 20Newsgroup,Reuters Newswire and IMDB dataset.

Global stability of interval recurrent neural networks

The robust global exponential stability of a class of interval recurrent neural networks（RNNs） is studied,and a new robust stability criterion is obtained in the form of linear matrix inequality.The problem of robust stability of interval RNNs is transformed into a problem of solving a class of linear matrix inequalities.Thus,the robust stability of interval RNNs can be analyzed by directly using the linear matrix inequalities（LMI） toolbox of MATLAB.Numerical example is given to show the effectiveness of the obtained results.

Modelling missile motion system using neural networks

The models of noallnear systems are idendried by recmeive pedctive ermrs(RPE) methed based on thelayered neural networks. To improve the identification precision, gain callcient and arentUm factor are itheucedinto the algorithm for the data are dids by noses and vny suddnly. this lerthm is applied to the twcmedeiling of rolling and pitchng angles of ndssiles. Simulation results shoW tha the proposed algurithm is sultable forthe modelling of nodrinear systems.

NONLINEAR MODELING AND CONTROLLING OF ARTIFICIAL MUSCLE SYSTEM USING NEURAL NETWORKS

The pneumatic artificial muscles are widely used in the fields of medicalrobots, etc. Neural networks are applied to modeling and controlling of artificial muscle system. Asingle-joint artificial muscle test system is designed. The recursive prediction error (RPE)algorithm which yields faster convergence than back propagation (BP) algorithm is applied to trainthe neural networks. The realization of RPE algorithm is given. The difference of modeling ofartificial muscles using neural networks with different input nodes and different hidden layer nodesis discussed. On this basis the nonlinear control scheme using neural networks for artificialmuscle system has been introduced. The experimental results show that the nonlinear control schemeyields faster response and higher control accuracy than the traditional linear control scheme.

A Kind of Second-Order Learning Algorithm Based on Generalized Cost Criteria in Multi-Layer Feed-Forward Neural Networks

A kind of second order algorithm--recursive approximate Newton algorithm was given by Karayiannis. The algorithm was simplified when it was formulated. Especially, the simplification to matrix Hessian was very reluctant, which led to the loss of valuable information and affected performance of the algorithm to certain extent. For multi layer feed forward neural networks, the second order back propagation recursive algorithm based generalized cost criteria was proposed. It is proved that it is equivalent to Newton recursive algorithm and has a second order convergent rate. The performance and application prospect are analyzed. Lots of simulation experiments indicate that the calculation of the new algorithm is almost equivalent to the recursive least square multiple algorithm. The algorithm and selection of networks parameters are significant and the performance is more excellent than BP algorithm and the second order learning algorithm that was given by Karayiannis.

Research of Energy-saving Control of Oil-well Power Heater Based on RNN Neural Network

For the beam pumping unit,the power consumption of oil-well power heater accounts for a large part of the pumping unit.Decreasing the energy consumption of the power heater is an important approach to reduce that of the pumping unit.To decrease the energy consumption of oil-well power heater,the proper control method is needed.Based on summarizing the existing control method of power heater,a control method of oil-well power heater of beam pumping unit based on RNN neural network is proposed.The method is forecasting the polished rod load of the beam pumping unit through RNN neural network and using the polished rod load for real-time closed-loop control of the power heater,which adjusts average output power,so as to decrease the power consumption.The experimental data show that the control method is entirely feasible.It not only ensures the oil production,but also improves the energy-saving effect of the pumping unit.

基于HHO-QRNN模型的大坝变形预测方法

为有效利用大坝位移数据集中的真实信息,提高预测模型精准度,缩减建模分析训练时间,提出基于卡尔曼滤波算法、完全噪声辅助聚合经验模态分解和准循环神经网络的大坝位移预测方法。首先,模型采用卡尔曼滤波算法对原始输入数据进行处理,提取行有效信息,消除观测噪声影响;其次,设计一种信号分解算法,从累计位移值提取出趋势项、周期项和随机项数据集,以分离不同诱发因素对于大坝位移量的影响;最后,提出一种基于改进哈里斯鹰算法优化准循环神经网络的位移预测算法,对不同数据集分别采用此算法建模预测,将预测结果对应叠加得到最终预测结果。以某水库大坝的历史位移观测数据集为例,将所提模型与其他传统预测模型进行对比分析,结果表明,该模型预测精度和训练速度等方面均有显著提升,验证了其可行性和先进性。

Enhancing Skin Cancer Diagnosis with Deep Learning:A Hybrid CNN-RNN Approach

Skin cancer diagnosis is difficult due to lesion presentation variability. Conventionalmethods struggle to manuallyextract features and capture lesions spatial and temporal variations. This study introduces a deep learning-basedConvolutional and Recurrent Neural Network (CNN-RNN) model with a ResNet-50 architecture which usedas the feature extractor to enhance skin cancer classification. Leveraging synergistic spatial feature extractionand temporal sequence learning, the model demonstrates robust performance on a dataset of 9000 skin lesionphotos from nine cancer types. Using pre-trained ResNet-50 for spatial data extraction and Long Short-TermMemory (LSTM) for temporal dependencies, the model achieves a high average recognition accuracy, surpassingprevious methods. The comprehensive evaluation, including accuracy, precision, recall, and F1-score, underscoresthe model’s competence in categorizing skin cancer types. This research contributes a sophisticated model andvaluable guidance for deep learning-based diagnostics, also this model excels in overcoming spatial and temporalcomplexities, offering a sophisticated solution for dermatological diagnostics research.

Optimized Phishing Detection with Recurrent Neural Network and Whale Optimizer Algorithm

Phishing attacks present a persistent and evolving threat in the cybersecurity land-scape,necessitating the development of more sophisticated detection methods.Traditional machine learning approaches to phishing detection have relied heavily on feature engineering and have often fallen short in adapting to the dynamically changing patterns of phishingUniformResource Locator(URLs).Addressing these challenge,we introduce a framework that integrates the sequential data processing strengths of a Recurrent Neural Network(RNN)with the hyperparameter optimization prowess of theWhale Optimization Algorithm(WOA).Ourmodel capitalizes on an extensive Kaggle dataset,featuring over 11,000 URLs,each delineated by 30 attributes.The WOA’s hyperparameter optimization enhances the RNN’s performance,evidenced by a meticulous validation process.The results,encapsulated in precision,recall,and F1-score metrics,surpass baseline models,achieving an overall accuracy of 92%.This study not only demonstrates the RNN’s proficiency in learning complex patterns but also underscores the WOA’s effectiveness in refining machine learning models for the critical task of phishing detection.

RNN循环神经网络的服务机器人交互手势辨识

服务机器人交互过程中机器人重要关节点难以确定,导致交互手势辨识难以增加,因此设计一种基于RNN循环神经网络的服务机器人交互手势辨识方法。利用Kinect捕获服务机器人交互手势深度图像,确定服务机器人交互过程中的重要关节点,提取服务机器人交互手势特征。根据手势特征提取结果,定义手势模板,采用RNN循环神经网络对手势模板进行学习处理,搭建服务机器人交互手势辨识模型,得到相关的交互手势辨识结果。实验测试结果表明,采用所提方法可以快速获取高精度的服务机器人交互手势辨识结果,实际应用效果好。

基于多特征融合与双向RNN的细粒度意见分析

文本细粒度意见分析主要有属性抽取和基于属性的情感分类2个任务,现有方法完成上述任务采用条件随机场(CRF)训练属性抽取模型,并运用循环神经网络(RNN)训练基于属性的情感分类模型。但同时完成2个任务则无法找到属性和情感倾向的对应关系。针对该问题,提出利用双向RNN构建基于序列标注的细粒度意见分析模型。通过融合文本的词向量、词性和依存关系等语言学特征,学习文本的修饰和语义信息,并设计一个时间序列标注模型,同时抽取属性实体判断文本的情感极性。在真实数据集上的实验结果表明,与CRF、TD-LSTM、AELSTM等模型相比,该模型情感分类效果提升明显。

基于BLSTM-RNN的船舶轨迹修复方法

针对内河干线船舶AIS轨迹数缺失问题,提出一种基于双向长短时记忆网络(BLSTM-RNN)模型的船舶轨迹数据修复方法。通过利用船舶轨迹上下文信息及其他回传特征作为模型输入,构建两层的双向循环神经网络(RNN)模型。在模型输入上,采用相关性分析及序列自相关系数,确定船舶轨迹点相关变量及轨迹序列自相关滞后值;在模型结构上,以ACC率为指标对模型超参数值进行合理设置,以长江干线航道武汉段及重庆段船舶轨迹数据为样本,对模型进行实证验证。实验结果表明:与线性及其他机器学习方法相比BLSTM-RNN方法在精度上有一定提升;在武汉段顺直河段实验中,将修复误差控制在15 m量级内,远低于其他非线性方法的50 m量级;在重庆复杂河段内,可将修复误差控制在10 m量级;模型解决了传统方法在长距离丢失点上精度缺失的问题,在20个连续点丢失的情况上,将修复误差降低至50m量级。

River channel flood forecasting method of coupling wavelet neural network with autoregressive model

Based on analyzing the limitations of the commonly used back-propagation neural network （BPNN）, a wavelet neural network （WNN） is adopted as the nonlinear river channel flood forecasting method replacing the BPNN. The WNN has the characteristics of fast convergence and improved capability of nonlinear approximation. For the purpose of adapting the timevarying characteristics of flood routing, the WNN is coupled with an AR real-time correction model. The AR model is utilized to calculate the forecast error. The coefficients of the AR real-time correction model are dynamically updated by an adaptive fading factor recursive least square（RLS） method. The application of the flood forecasting method in the cross section of Xijiang River at Gaoyao shows its effectiveness.