Long Short-Term Memory Recurrent Neural Network-Based Acoustic Model Using Connectionist Temporal Classification on a Large-Scale Training Corpus

A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a forced aligned Hidden Markov Model(HMM) state sequence obtained from the GMM-based acoustic model. Therefore, it requires a long computation time for training both the GMM-based acoustic model and a deep learning-based acoustic model. In order to solve this problem, an acoustic model using CTC algorithm is proposed. CTC algorithm does not require the GMM-based acoustic model because it does not use the forced aligned HMM state sequence. However, previous works on a LSTM RNN-based acoustic model using CTC used a small-scale training corpus. In this paper, the LSTM RNN-based acoustic model using CTC is trained on a large-scale training corpus and its performance is evaluated. The implemented acoustic model has a performance of 6.18% and 15.01% in terms of Word Error Rate(WER) for clean speech and noisy speech, respectively. This is similar to a performance of the acoustic model based on the hybrid method.

A forecasting model for wave heights based on a long short-term memory neural network

To explore new operational forecasting methods of waves,a forecasting model for wave heights at three stations in the Bohai Sea has been developed.This model is based on long short-term memory(LSTM)neural network with sea surface wind and wave heights as training samples.The prediction performance of the model is evaluated,and the error analysis shows that when using the same set of numerically predicted sea surface wind as input,the prediction error produced by the proposed LSTM model at Sta.N01 is 20%,18%and 23%lower than the conventional numerical wave models in terms of the total root mean square error(RMSE),scatter index(SI)and mean absolute error(MAE),respectively.Particularly,for significant wave height in the range of 3–5 m,the prediction accuracy of the LSTM model is improved the most remarkably,with RMSE,SI and MAE all decreasing by 24%.It is also evident that the numbers of hidden neurons,the numbers of buoys used and the time length of training samples all have impact on the prediction accuracy.However,the prediction does not necessary improve with the increase of number of hidden neurons or number of buoys used.The experiment trained by data with the longest time length is found to perform the best overall compared to other experiments with a shorter time length for training.Overall,long short-term memory neural network was proved to be a very promising method for future development and applications in wave forecasting.

Attention-based long short-term memory fully convolutional network for chemical process fault diagnosis

A correct and timely fault diagnosis is important for improving the safety and reliability of chemical processes. With the advancement of big data technology, data-driven fault diagnosis methods are being extensively used and still have considerable potential. In recent years, methods based on deep neural networks have made significant breakthroughs, and fault diagnosis methods for industrial processes based on deep learning have attracted considerable research attention. Therefore, we propose a fusion deeplearning algorithm based on a fully convolutional neural network(FCN) to extract features and build models to correctly diagnose all types of faults. We use long short-term memory(LSTM) units to expand our proposed FCN so that our proposed deep learning model can better extract the time-domain features of chemical process data. We also introduce the attention mechanism into the model, aimed at highlighting the importance of features, which is significant for the fault diagnosis of chemical processes with many features. When applied to the benchmark Tennessee Eastman process, our proposed model exhibits impressive performance, demonstrating the effectiveness of the attention-based LSTM FCN in chemical process fault diagnosis.

Landslide displacement prediction based on optimized empirical mode decomposition and deep bidirectional long short-term memory network

There are two technical challenges in predicting slope deformation.The first one is the random displacement,which could not be decomposed and predicted by numerically resolving the observed accumulated displacement and time series of a landslide.The second one is the dynamic evolution of a landslide,which could not be feasibly simulated simply by traditional prediction models.In this paper,a dynamic model of displacement prediction is introduced for composite landslides based on a combination of empirical mode decomposition with soft screening stop criteria(SSSC-EMD)and deep bidirectional long short-term memory(DBi-LSTM)neural network.In the proposed model,the time series analysis and SSSC-EMD are used to decompose the observed accumulated displacements of a slope into three components,viz.trend displacement,periodic displacement,and random displacement.Then,by analyzing the evolution pattern of a landslide and its key factors triggering landslides,appropriate influencing factors are selected for each displacement component,and DBi-LSTM neural network to carry out multi-datadriven dynamic prediction for each displacement component.An accumulated displacement prediction has been obtained by a summation of each component.For accuracy verification and engineering practicability of the model,field observations from two known landslides in China,the Xintan landslide and the Bazimen landslide were collected for comparison and evaluation.The case study verified that the model proposed in this paper can better characterize the"stepwise"deformation characteristics of a slope.As compared with long short-term memory(LSTM)neural network,support vector machine(SVM),and autoregressive integrated moving average(ARIMA)model,DBi-LSTM neural network has higher accuracy in predicting the periodic displacement of slope deformation,with the mean absolute percentage error reduced by 3.063%,14.913%,and 13.960%respectively,and the root mean square error reduced by 1.951 mm,8.954 mm and 7.790 mm respectively.Conclusively,this model not only has high prediction accuracy but also is more stable,which can provide new insight for practical landslide prevention and control engineering.

Real-time UAV path planning based on LSTM network

To address the shortcomings of single-step decision making in the existing deep reinforcement learning based unmanned aerial vehicle(UAV)real-time path planning problem,a real-time UAV path planning algorithm based on long shortterm memory(RPP-LSTM)network is proposed,which combines the memory characteristics of recurrent neural network(RNN)and the deep reinforcement learning algorithm.LSTM networks are used in this algorithm as Q-value networks for the deep Q network(DQN)algorithm,which makes the decision of the Q-value network has some memory.Thanks to LSTM network,the Q-value network can use the previous environmental information and action information which effectively avoids the problem of single-step decision considering only the current environment.Besides,the algorithm proposes a hierarchical reward and punishment function for the specific problem of UAV real-time path planning,so that the UAV can more reasonably perform path planning.Simulation verification shows that compared with the traditional feed-forward neural network(FNN)based UAV autonomous path planning algorithm,the RPP-LSTM proposed in this paper can adapt to more complex environments and has significantly improved robustness and accuracy when performing UAV real-time path planning.

Wind Speed Prediction Based on Improved VMD-BP-CNN-LSTM Model

Amid the randomness and volatility of wind speed, an improved VMD-BP-CNN-LSTM model for short-term wind speed prediction was proposed to assist in power system planning and operation in this paper. Firstly, the wind speed time series data was processed using Variational Mode Decomposition (VMD) to obtain multiple frequency components. Then, each individual frequency component was channeled into a combined prediction framework consisting of BP neural network (BPNN), Convolutional Neural Network (CNN) and Long Short-Term Memory Network (LSTM) after the execution of differential and normalization operations. Thereafter, the predictive outputs for each component underwent integration through a fully-connected neural architecture for data fusion processing, resulting in the final prediction. The VMD decomposition technique was introduced in a generalized CNN-LSTM prediction model;a BPNN model was utilized to predict high-frequency components obtained from VMD, and incorporated a fully connected neural network for data fusion of individual component predictions. Experimental results demonstrated that the proposed improved VMD-BP-CNN-LSTM model outperformed other combined prediction models in terms of prediction accuracy, providing a solid foundation for optimizing the safe operation of wind farms.

基于VMD-SSA-LSTM考虑刀具磨损的数控铣床切削功率预测模型研究

传统的切削过程功率获取需要基于复杂的切削功率模型且很少考虑刀具磨损的影响,针对此设计了一种基于变分模态分解(VMD)、麻雀搜索算法(SSA)、长短时记忆(LSTM)神经网络的考虑刀具磨损的数控铣床切削功率预测模型,该模型无需解构数控铣床运行过程的能耗机理,基于一次性的历史实验数据即可实现数控铣床切削过程功率的高精度预测。首先,采用人工智能机器视觉技术对刀具磨损图片进行分析处理,获取刀具磨损图像的数字化特征,从而得到刀具最大磨损量;然后,建立基于VMD-SSA-LSTM考虑刀具磨损的数控铣床切削功率预测模型,利用VMD对数控铣床运行数据进行分解,采用SSA算法对LSTM神经网络超参数进行寻优,并将分解出的铣床运行数据分量输入到LSTM神经网络中,接着将每个分量的预测值相加,得到切削功率预测值;最后以面铣加工为例,将所提出的预测模型与BP神经网络、LSTM神经网络和传统模型进行对比分析,验证了所提模型的有效性和优越性。

基于Transformer-LSTM的闽南语唇语识别

针对端到端句子级闽南语唇语识别的问题,提出一种基于Transformer和长短时记忆网络(LSTM)的编解码模型.编码器采用时空卷积神经网络及Transformer编码器用于提取唇读序列时空特征,解码器采用长短时记忆网络并结合交叉注意力机制用于文本序列预测.最后,在自建闽南语唇语数据集上进行实验.实验结果表明:模型能有效地提高唇语识别的准确率.

基于多源信息融合和WOA-CNN-LSTM的外脚手架隐患分类预警研究

面对施工现场外脚手架隐患信息的多样性,传统的基于传感器监测的单一信号预警研究存在容错力不佳、含有信息有限等问题。针对施工现场外脚手架“图像+监测”数据,提出一种基于数据层和特征层信息融合的脚手架隐患分类预警方法。首先,利用Revit三维建模软件建立外脚手架实体模型,对不同初始隐患下的外脚手架进行有限元分析,划分隐患预警等级;其次,利用无迹卡尔曼滤波算法(Unscented Kalman Filter,UKF)及卷积长短时记忆网络(Convolutional Neural Network-Long Short Term Memory Network,CNN-LSTM)实现脚手架同类信息数据层融合及异类信息特征层融合;最后,通过实时收集西安市某在建项目落地式双排扣件式钢管脚手架隐患信息,对其进行分类预警,并使用鲸鱼优化算法(Whale Optimization Algorithm,WOA)对CNN-LSTM网络进行参数优化,发现隐藏节点个数为30、学习率为0.0072、正则化系数为1×10^(-4)时分类效果最佳,优化后预警精度达到了91.4526%。通过可视化WOA-CNN-LSTM、CNN-LSTM、CNN-SVM(Support Vector Machine,支持向量机)及CNN-GRU(Gate Recurrent Unit,门控循环单元)分类预警结果,证实了优化后的CNN-LSTM网络在脚手架分类预警方面的优越性。

基于注意力机制的CNN-BiLSTM的IGBT剩余使用寿命预测

针对绝缘栅双极型晶体管(IGBT)可靠性问题,提出了一种融合卷积神经网络(CNN)、双向长短期记忆(BiLSTM)网络和注意力机制的剩余使用寿命(RUL)预测模型,可用于IGBT的寿命预测。模型中使用CNN提取特征参数,BiLSTM提取时序信息,注意力机制加权处理特征参数。使用IGBT加速老化数据集对提出的模型进行验证。结果表明,对比自回归差分移动平均(ARIMA)、长短期记忆(LSTM)、多层LSTM(Multi-LSTM)、 BiLSTM预测模型,在均方根误差和决定系数等评价指标方面该模型的性能最优。验证了提出的寿命预测模型对IGBT失效预测是有效的。

基于LSTM算法的冷轧机架振动动态预警分析

在实际生产阶段冷轧机具有多态性与时变性,需要对轧机振动动态预警进行转换形成包含多变量的时间序列预警。建立了一种基于LSTM算法的冷轧机振动预警模型。研究结果表明:提高步长后模型预警性能获得明显提升,随着步长到达5后,模型表现也逐渐变差,步长为4时,获得了最优预警效果。结合实际振动报警阈值,在预警振动能量值升高至阈值75%时激发形成振动预报,第一卷与第二卷分别提前预报1.6s与3.2s。该研究对控制板材的精度具有很好的指导意义。

基于LSTM-NeuralProphet模型的城市需水预测方法研究

城市水资源规划和管理是确保城市可持续发展和居民生活基本需求得到满足的关键环节,城市短期需水预测是城市水资源规划和管理的基础。由于气温、降水量和蒸发量等随季节变化明显,直接影响不同季节的用水峰值、高峰期,导致传统基于时间序列算法的固定时隙预测无法适应时隙的变化,从而不能保证预测精度。针对固定时隙预测精度低的问题,研究了基于四季24 h时间分辨率和夏季15 min时间分辨率的双时间尺度城市短期需水预测模型。该模型使用Anomaly-Transformer模型进行异常值检测,并通过分段曲线拟合对异常值校正,采用主成分分析法对城市短期需水影响因子进行分析提取主成分,在AutoML的标准模型分析中选取三个效果最好的模型作为Stacking模型的基学习器再结合长短期记忆网络(Long Short-Term Memory,LSTM)和Optune框架超参数优化后的NeuralProphet模型对双时间尺度的城市短期需水量进行预测,同时加入安全网机制,以保证LSTM-NeuralProphet模型的精确度。与其他模型(LSTM模型、NeuralProphet模型、BP神经网络模型)相比,LSTM-NeuralProphet模型的平均绝对误差在四季24 h时间分辨率的数据集上降低了0.18%~1.96%,在夏季15 min时间分辨率的数据集上降低了0.45%~11.90%。实验结果表明,LSTM-NeuralProphet模型具有更好的拟合效果和更高的预测精度,能较准确地预测双时间尺度下的城市需水量,可以较好地应用于城市短期需水预测研究中。

Dynamic Hand Gesture Recognition Based on Short-Term Sampling Neural Networks

Hand gestures are a natural way for human-robot interaction.Vision based dynamic hand gesture recognition has become a hot research topic due to its various applications.This paper presents a novel deep learning network for hand gesture recognition.The network integrates several well-proved modules together to learn both short-term and long-term features from video inputs and meanwhile avoid intensive computation.To learn short-term features,each video input is segmented into a fixed number of frame groups.A frame is randomly selected from each group and represented as an RGB image as well as an optical flow snapshot.These two entities are fused and fed into a convolutional neural network(Conv Net)for feature extraction.The Conv Nets for all groups share parameters.To learn longterm features,outputs from all Conv Nets are fed into a long short-term memory(LSTM)network,by which a final classification result is predicted.The new model has been tested with two popular hand gesture datasets,namely the Jester dataset and Nvidia dataset.Comparing with other models,our model produced very competitive results.The robustness of the new model has also been proved with an augmented dataset with enhanced diversity of hand gestures.

基于Bi-LSTM的浅层地下双孔洞探测技术

文章探究一种基于深度学习的浅层地下孔洞探测技术,以应对地下孔洞给桩基施工安全所造成的严重威胁。基于浅层地震反射波法的原理,采用基础施工过程中的桩锤激震作为激励源,通过在探测区域地表上布置少量加速度传感器采集孔洞反射信号,并将反射信号作为深度学习的输入,以输出孔洞信息,建立一种新型的智能孔洞探测方法。结果表明,双向长短期记忆神经网络(bidirectional long short-term memory neural network,Bi-LSTM)的预测模型对于地下双孔洞的工况具有较高的识别准确率,在容许误差为2 m的情况下,孔洞位置和直径的预测准确率可达95.3%。该研究验证了基于深度学习的多孔洞探测技术的可行性,有望为施工前期土层地质状况的评估提供技术保障。

基于层叠式残差LSTM网络的桥梁非线性地震响应预测

提出了一种基于层叠式残差长短时记忆神经网络(residual long short-term memory neural network,ResLSTM)的数据驱动建模方法,实现桥梁非线性地震响应预测。该方法利用长短时记忆(long short-term memory, LSTM)网络在长序列回归中的优势,并采用残差连接结构降低深度神经网络中的梯度回传难度,提高了有限数据下的深度网络预测性能。同时,通过采用层叠式序列结构,降低深度神经网络隐藏层节点数目,进一步提升深度神经网络的预测精度。随后,通过两跨预应力混凝土连续梁桥与组合梁斜拉桥的数值算例对该方法进行验证。神经网络的训练样本与测试样本均源自桥梁有限元模型的增量动力分析结果。此外,采用该方法成功预测了美国Meloland Overpass桥的地震响应,并与历史监测数据进行对比验证。结果表明:ResLSTM网络是一种鲁棒性良好、计算效率高的非线性地震响应预测方法,能够利用少量数据快速准确地预测桥梁结构在地震作用下的动力响应,在桥梁抗震性能评价中具有重要的应用潜力。

基于相关性检验的VMD-LSTM耦合模型月径流模拟研究

近年来,极端强降雨和干旱事件频发,流域水文过程的不确定性变化加剧,使得流域中长期径流预测的难度增加。为提升LSTM(长短期记忆神经网络)模型对径流时序变化的捕捉及拟合能力,以博阳河流域为研究区域,选取月降雨、蒸发及流量数据,利用VMD(变分模态分解)和相关性检验,排除无关频率分量对LSTM模型规律学习的干扰,以达到模型输入优选的目的;此外,还考虑了VMD与LSTM模型的不同耦合方式对模型精度和稳定性的影响,最终优选出二者兼具的VMD-LSTM月径流耦合模式。结果表明:VMD-LSTM耦合模型可显著提升模拟精度,但在模型稳定性方面有所欠缺;而基于相关性检验的VMD-LSTM耦合模型不仅能够进一步提高模型精度,并且在模型的稳定性方面也有所改进。在基于相关性检验的VMD-LSTM耦合模型的不同耦合方式对比中,对输入、输出均进行VMD分解且对输入变量进行优选的D_(1)耦合方案的模拟效果最好,其60次模拟计算的NSE均为0.98以上且稳定性极佳;另外,在分析方案D_(1)的可解释性时发现历史径流对于LSTM模型的影响要比降雨和蒸发大。该研究结论可为流域水资源管理提供精准可信的中长期径流模拟成果。

基于时序序列分解和IBAS LSTM的滑坡数据预测模型

针对传统静态机器学习模型在周期项位移预测中的缺陷和动态神经网络超参数人工选择困难的问题,在时序序列分解的基础上,提出一种新的滑坡预测耦合模型。首先,用最大相关最小冗余算法对周期项位移筛选合适的环境特征,作为长短期记忆人工神经网络的输入。然后,在天牛须搜索算法搜索过程中引入反馈机制,以避免原算法中出现远离最优解的问题;在算法迭代过程中将固定的递减因子改为动态递减因子,以提升前期全局和后期局部的寻优能力;利用改进的天牛须搜索算法对长短期记忆人工神经网络超参数进行寻优,以获得最佳的网络参数组合。最后,重构趋势项和周期项预测结果,得到最终预测位移。以发耳滑坡为例进行分析,结果表明:相较于其他方法,所提模型在平均绝对误差、均方根误差以及拟合度等方面更具优势。

Neural Network-Based State of Charge Estimation Method for Lithium-ion Batteries Based on Temperature

Lithium-ion batteries are commonly used in electric vehicles,mobile phones,and laptops.These batteries demonstrate several advantages,such as environmental friendliness,high energy density,and long life.However,battery overcharging and overdischarging may occur if the batteries are not monitored continuously.Overcharging causesfire and explosion casualties,and overdischar-ging causes a reduction in the battery capacity and life.In addition,the internal resistance of such batteries varies depending on their external temperature,elec-trolyte,cathode material,and other factors;the capacity of the batteries decreases with temperature.In this study,we develop a method for estimating the state of charge(SOC)using a neural network model that is best suited to the external tem-perature of such batteries based on their characteristics.During our simulation,we acquired data at temperatures of 25°C,30°C,35°C,and 40°C.Based on the tem-perature parameters,the voltage,current,and time parameters were obtained,and six cycles of the parameters based on the temperature were used for the experi-ment.Experimental data to verify the proposed method were obtained through a discharge experiment conducted using a vehicle driving simulator.The experi-mental data were provided as inputs to three types of neural network models:mul-tilayer neural network(MNN),long short-term memory(LSTM),and gated recurrent unit(GRU).The neural network models were trained and optimized for the specific temperatures measured during the experiment,and the SOC was estimated by selecting the most suitable model for each temperature.The experimental results revealed that the mean absolute errors of the MNN,LSTM,and GRU using the proposed method were 2.17%,2.19%,and 2.15%,respec-tively,which are better than those of the conventional method(4.47%,4.60%,and 4.40%).Finally,SOC estimation based on GRU using the proposed method was found to be 2.15%,which was the most accurate.

基于CNN-LSTM的永磁同步风力发电机转子偏心早期故障诊断

对永磁同步风力发电机转子早期动偏心和早期静偏心故障的特点和诊断方法进行研究,通过Ansys建立永磁同步风力发电机的早期动偏心和早期静偏心模型,提出一种基于CNN-LSTM的故障诊断和分类方法。通过对永磁同步风力发电机定子三相电流及其Welch功率谱数据的分析,判断是否为正常的动偏心趋势和静偏心趋势;然后通过空载电动势对不同故障程度进行分类。最后,在神经网络模型中完成故障诊断和分类任务。所提方法大大降低了设备维修成本,可准确快速地识别转子早期偏心故障。