一种基于long short-term memory的唇语识别方法

唇动视觉信息是说话内容的重要载体。受嘴唇外观、背景信息和说话习惯等影响,即使说话者说相同的内容,唇动视觉信息也会相差很大。为解决唇语视觉信息多样性的问题,提出一种基于long short-term memory(LSTM)的新的唇语识别方法。以往大多数的方法从嘴唇外表信息入手。本方法用嘴唇关键点坐标描述嘴唇形变信息作为唇语视频的特征,它具有类内一致性和类间区分性的特点。然后利用LSTM对特征进行时序编码,它能学习具有区分性和泛化性的空间-时序特征。在公开的唇语数据集GRID、MIRACL-VC和Oulu VS上对本方法做了针对分割的单词或短语的说话者独立的唇语识别评估。在GRID和MIRACL-VC上,本方法的准确率比传统方法至少高30%;在Oulu VS上,本方法的准确率接近于最优结果。以上实验结果表明,本文提出的基于LSTM的唇语识别方法有效地解决了唇语视觉信息多样性的问题。

Tool Health Condition Recognition Method for High Speed Milling of Titanium Alloy Based on Principal Component Analysis (PCA) and Long Short Term Memory (LSTM)

The healthy condition of the milling tool has a very high impact on the machining quality of the titanium components.Therefore,it is important to recognize the healthy condition of the tool and replace the damaged cutter at the right time.In order to recognize the health condition of the milling cutter,a method based on the long short term memory(LSTM)was proposed to recognize tool health state in this paper.The various signals collected in the tool wear experiments were analyzed by time-domain statistics,and then the extracted data were generated by principal component analysis(PCA)method.The preprocessed data extracted by PCA is transmitted to the LSTM model for recognition.Compared with back propagation neural network(BPNN)and support vector machine(SVM),the proposed method can effectively utilize the time-domain regulation in the data to achieve higher recognition speed and accuracy.

Conditional Random Field Tracking Model Based on a Visual Long Short Term Memory Network

In dense pedestrian tracking,frequent object occlusions and close distances between objects cause difficulty when accurately estimating object trajectories.In this study,a conditional random field tracking model is established by using a visual long short term memory network in the three-dimensional(3D)space and the motion estimations jointly performed on object trajectory segments.Object visual field information is added to the long short term memory network to improve the accuracy of the motion related object pair selection and motion estimation.To address the uncertainty of the length and interval of trajectory segments,a multimode long short term memory network is proposed for the object motion estimation.The tracking performance is evaluated using the PETS2009 dataset.The experimental results show that the proposed method achieves better performance than the tracking methods based on the independent motion estimation.

Long Short-Term Memory Recurrent Neural Network-Based Acoustic Model Using Connectionist Temporal Classification on a Large-Scale Training Corpus

A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a forced aligned Hidden Markov Model(HMM) state sequence obtained from the GMM-based acoustic model. Therefore, it requires a long computation time for training both the GMM-based acoustic model and a deep learning-based acoustic model. In order to solve this problem, an acoustic model using CTC algorithm is proposed. CTC algorithm does not require the GMM-based acoustic model because it does not use the forced aligned HMM state sequence. However, previous works on a LSTM RNN-based acoustic model using CTC used a small-scale training corpus. In this paper, the LSTM RNN-based acoustic model using CTC is trained on a large-scale training corpus and its performance is evaluated. The implemented acoustic model has a performance of 6.18% and 15.01% in terms of Word Error Rate(WER) for clean speech and noisy speech, respectively. This is similar to a performance of the acoustic model based on the hybrid method.

Short-Term Relay Quality Prediction Algorithm Based on Long and Short-Term Memory

The fraction defective of semi-finished products is predicted to optimize the process of relay production lines, by which production quality and productivity are increased, and the costs are decreased. The process parameters of relay production lines are studied based on the long-and-short-term memory network. Then, the Keras deep learning framework is utilized to build up a short-term relay quality prediction algorithm for the semi-finished product. A simulation model is used to study prediction algorithm. The simulation results show that the average prediction absolute error of the fraction is less than 5%. This work displays great application potential in the relay production lines.

Predicting and Curing Depression Using Long Short Term Memory and Global Vector

In today’s world, there are many people suffering from mentalhealth problems such as depression and anxiety. If these conditions are notidentified and treated early, they can get worse quickly and have far-reachingnegative effects. Unfortunately, many people suffering from these conditions,especially depression and hypertension, are unaware of their existence until theconditions become chronic. Thus, this paper proposes a novel approach usingBi-directional Long Short-Term Memory (Bi-LSTM) algorithm and GlobalVector (GloVe) algorithm for the prediction and treatment of these conditions.Smartwatches and fitness bands can be equipped with these algorithms whichcan share data with a variety of IoT devices and smart systems to betterunderstand and analyze the user’s condition. We compared the accuracy andloss of the training dataset and the validation dataset of the two modelsnamely, Bi-LSTM without a global vector layer and with a global vector layer.It was observed that the model of Bi-LSTM without a global vector layer hadan accuracy of 83%,while Bi-LSTMwith a global vector layer had an accuracyof 86% with a precision of 86.4%, and an F1 score of 0.861. In addition toproviding basic therapies for the treatment of identified cases, our model alsohelps prevent the deterioration of associated conditions, making our methoda real-world solution.

Analyses of fear memory in Arc/Arg3.1-deficient mice: intact short-term memory and impaired long-term and remote memory

Activity-regulated cytoskeleton-associated protein (Arc/Arg3.1) was originally identified in patients with seizures. It is densely distributed in the hip-pocampus and amygdala in particular. Because the expression of Arc/Arg3.1 is regulated by nerve in-puts, it is thought to be an immediate early gene. As shown both in vitro and in vivo, Arc/Arg3.1 is in-volved in synaptic consolidation and regulates some forms of learning and memory in rats and mice [1,2]. Furthermore, a recent study suggests that Arc/Arg3.1 may play a significant role in signal transmission via AMPA-type glutamate receptors [3-5]. Therefore, we conducted a detailed analysis of fear memory in Arc/Arg3.1-deficient mice. As previously reported, the knockout animals exhib-ited impaired fear memory in both contextual and cued test situations. Although Arc/Arg3.1-deficient mice showed almost the same performance as wild-type littermates 4 hr after a conditioning trial, their performance was impaired in the retention test after 24 hr or longer, either with or without reconsolidation. Immunohistochemical analyses showed an abnormal density of GluR1 in the hip-pocampus of Arc/Arg3.1-deficient mice;however, an application of AMPA potentiator did not improve memory performance in the mutant mice. Memory impairment in Arc/Arg3.1-deficient mice is so ro-bust that the mice provide a useful tool for devel-oping treatments for memory impairment.

State of Health Estimation of Lithium-Ion Batteries Using Support Vector Regression and Long Short-Term Memory

Lithium-ion batteries are the most widely accepted type of battery in the electric vehicle industry because of some of their positive inherent characteristics. However, the safety problems associated with inaccurate estimation and prediction of the state of health of these batteries have attracted wide attention due to the adverse negative effect on vehicle safety. In this paper, both machine and deep learning models were used to estimate the state of health of lithium-ion batteries. The paper introduces the definition of battery health status and its importance in the electric vehicle industry. Based on the data preprocessing and visualization analysis, three features related to actual battery capacity degradation are extracted from the data. Two learning models, SVR and LSTM were employed for the state of health estimation and their respective results are compared in this paper. The mean square error and coefficient of determination were the two metrics for the performance evaluation of the models. The experimental results indicate that both models have high estimation results. However, the metrics indicated that the SVR was the overall best model.

Short-TermWind Power Prediction Based on Combinatorial Neural Networks

Wind power volatility not only limits the large-scale grid connection but also poses many challenges to safe grid operation.Accurate wind power prediction can mitigate the adverse effects of wind power volatility on wind power grid connections.For the characteristics of wind power antecedent data and precedent data jointly to determine the prediction accuracy of the prediction model,the short-term prediction of wind power based on a combined neural network is proposed.First,the Bi-directional Long Short Term Memory(BiLSTM)network prediction model is constructed,and the bi-directional nature of the BiLSTM network is used to deeply mine the wind power data information and find the correlation information within the data.Secondly,to avoid the limitation of a single prediction model when the wind power changes abruptly,the Wavelet Transform-Improved Adaptive Genetic Algorithm-Back Propagation(WT-IAGA-BP)neural network based on the combination of the WT-IAGA-BP neural network and BiLSTM network is constructed for the short-term prediction of wind power.Finally,comparing with LSTM,BiLSTM,WT-LSTM,WT-BiLSTM,WT-IAGA-BP,and WT-IAGA-BP&LSTM prediction models,it is verified that the wind power short-term prediction model based on the combination of WT-IAGA-BP neural network and BiLSTM network has higher prediction accuracy.

Wind Power Forecasting Using Grey Wolf Optimized Long Short-Term Memory Based on Numerical Weather Prediction

Wind power generation is among the most promising and eco-friendly energy sources today. Wind Power Forecasting (WPF) is essential for boosting energy efficiency and maintaining the operational stability of power grids. However, predicting wind power comes with significant challenges, such as weather uncertainties, wind variability, complex terrain, limited data, insufficient measurement infrastructure, intricate interdependencies, and short lead times. These factors make it difficult to accurately forecast wind behavior and respond to sudden power output changes. This study aims to precisely forecast electricity generation from wind turbines, minimize grid operation uncertainties, and enhance grid reliability. It leverages historical wind farm data and Numerical Weather Prediction data, using k-Nearest Neighbors for pre-processing, K-means clustering for categorization, and Long Short-Term Memory (LSTM) networks for training and testing, with model performance evaluated across multiple metrics. The Grey Wolf Optimized (GWO) LSTM classification technique, a deep learning model suited to time series analysis, effectively handles temporal dependencies in input data through memory cells and gradient-based optimization. Inspired by grey wolves’ hunting strategies, GWO is a population-based metaheuristic optimization algorithm known for its strong performance across diverse optimization tasks. The proposed Grey Wolf Optimized Deep Learning model achieves an R-squared value of 0.97279, demonstrating that it explains 97.28% of the variance in wind power data. This model surpasses a reference study that achieved an R-squared value of 0.92 with a hybrid deep learning approach but did not account for outliers or anomalous data.

Short Term Traffic Flow Prediction Using Hybrid Deep Learning

Traffic flow prediction in urban areas is essential in the IntelligentTransportation System (ITS). Short Term Traffic Flow (STTF) predictionimpacts traffic flow series, where an estimation of the number of vehicleswill appear during the next instance of time per hour. Precise STTF iscritical in Intelligent Transportation System. Various extinct systems aim forshort-term traffic forecasts, ensuring a good precision outcome which was asignificant task over the past few years. The main objective of this paper is topropose a new model to predict STTF for every hour of a day. In this paper,we have proposed a novel hybrid algorithm utilizing Principal ComponentAnalysis (PCA), Stacked Auto-Encoder (SAE), Long Short Term Memory(LSTM), and K-Nearest Neighbors (KNN) named PALKNN. Firstly, PCAremoves unwanted information from the dataset and selects essential features.Secondly, SAE is used to reduce the dimension of input data using onehotencoding so the model can be trained with better speed. Thirdly, LSTMtakes the input from SAE, where the data is sorted in ascending orderbased on the important features and generates the derived value. Finally,KNN Regressor takes information from LSTM to predict traffic flow. Theforecasting performance of the PALKNN model is investigated with OpenRoad Traffic Statistics dataset, Great Britain, UK. This paper enhanced thetraffic flow prediction for every hour of a day with a minimal error value.An extensive experimental analysis was performed on the benchmark dataset.The evaluated results indicate the significant improvement of the proposedPALKNN model over the recent approaches such as KNN, SARIMA, LogisticRegression, RNN, and LSTM in terms of root mean square error (RMSE)of 2.07%, mean square error (MSE) of 4.1%, and mean absolute error (MAE)of 2.04%.

Deep Learning Network for Energy Storage Scheduling in Power Market Environment Short-Term Load Forecasting Model

In the electricity market,fluctuations in real-time prices are unstable,and changes in short-term load are determined by many factors.By studying the timing of charging and discharging,as well as the economic benefits of energy storage in the process of participating in the power market,this paper takes energy storage scheduling as merely one factor affecting short-term power load,which affects short-term load time series along with time-of-use price,holidays,and temperature.A deep learning network is used to predict the short-term load,a convolutional neural network(CNN)is used to extract the features,and a long short-term memory(LSTM)network is used to learn the temporal characteristics of the load value,which can effectively improve prediction accuracy.Taking the load data of a certain region as an example,the CNN-LSTM prediction model is compared with the single LSTM prediction model.The experimental results show that the CNN-LSTM deep learning network with the participation of energy storage in dispatching can have high prediction accuracy for short-term power load forecasting.

Comparative study on the performance of ConvLSTM and ConvGRU in classification problems-taking early warning of short-duration heavy rainfall as an example

卷积长短期记忆单元ConvLSTM和卷积门控循环单元ConvGRU是两种广泛应用的深度学习单元,通过将循环机制与卷积运算相结合,常常用于时空序列的预测.为了明确上述两种模型的收敛速度和分类能力,需要使用相同的模型架构对相同的分类问题进行预测.本研究将北京短时强降水区级预警问题看作深度学习中的二分类问题,使用京津冀雷达网的组合反射率数据和北京区域内的自动气象站降雨数据进行深度学习模型的训练和评估.结果表明,ConvGRU的收敛速度比ConvLSTM快约25%.ConvLSTM和ConvGRU的预警性能随地区,时间,降雨强度的变化趋势相似,但大部分ConvLSTM的得分较高,少数情况下ConvGRU的得分较高.

基于改进LSTM的数码雷管模组印刷质量预测

由于数码雷管模组印刷过程中生产工艺复杂、强时序性等特点,其质量的精准预测已成为提高产品质量管理水平的关键。基于此提出一种改进长短期记忆(long short-term memory,LSTM)网络的数码雷管模组印刷质量预测模型。首先根据数码雷管模组印刷过程提炼机器运行参数、环境参数与检测参数作为印刷产品质量的原始特征,并对关键检测参数进行时序特征重构以增强特征表达能力;其次基于改进的LSTM网络建立数码雷管模组印刷特征提取框架,采用卷积神经网络提取空间特征避免LSTM挖掘高维印刷特征时隐含关系的不足,通过全局注意力机制自适应学习不同时刻印刷特征对印刷产品质量的贡献度,为LSTM提取的深层时序特征分配不同权值;最后以深层特征作为输入,通过全连接网络实现数码雷管模组印刷产品的质量预测。实验结果表明,相较于BP神经网络、门控循环单元网络、LSTM等预测方法,改进的LSTM网络有效提高了数码雷管模组印刷产品质量的预测精度。

基于ARIMA-LSTM的矿区地表沉降预测方法

煤矿开采安全问题尤其是采空区地表沉降现象会对人员安全及工程安全造成威胁,研究合适的矿区地表沉降预测方法具有很大意义。矿区地表沉降影响因素复杂,单一的深度学习模型对矿区地表沉降数据拟合效果差且现有的地表沉降预测研究多是单独进行概率预测或考虑时序特性进行点预测,难以在考虑数据的时序特征的同时对其随机性进行定量描述。针对此问题,在对数据本身性质进行观察分析后选择差分整合移动平均自回归(ARIMA)模型进行时序特征的概率预测,结合长短时记忆(LSTM)网络模型来学习复杂的且具有长期依赖性的非线性时序特征。提出基于ARIMA-LSTM的地表沉降预测模型,利用ARIMA模型对数据的时序线性部分进行预测,并将ARIMA模型预测的残差数据辅助LSTM模型训练,在考虑时序特征的同时对数据的随机性进行描述。研究结果表明,相较于单独采用ARIMA或LSTM模型,该方法具有更高的预测精度(MSE为0.262 87,MAE为0.408 15,RMSE为0.512 71)。进一步的对比结果显示,预测结果与雷达卫星影像数据(经SBAS-INSAR处理后)趋势一致,证实了该方法的有效性。

基于BP-DCKF-LSTM的锂离子电池SOC估计

电池荷电状态(SOC)的准确估计是电池管理系统(BMS)的核心功能之一。为了提高锂电池SOC估算精度,提出了一种将反向传播神经网络(BP)、双容积卡尔曼滤波(DCKF)和长短期记忆神经网络(LSTM)相结合的SOC估计方法。针对多温度条件下传统多项式拟合法在拟合开路电压(OCV)与SOC时效果较差的问题,提出了一种基于BP神经网络的拟合方法,通过验证表明该方法能有效提高拟合精度。针对单独使用模型法或数据驱动法估计SOC各自存在的优缺点,提出了一种将DCKF与LSTM相结合的估计方法,在提高估计精度的同时,可以减少参数调节时间和训练成本。实验验证表明,BP-DCKF-LSTM算法的均方根误差(RMSE)和平均绝对误差(MAE)分别小于0.5%和0.4%,具有较高的SOC估算精度和鲁棒性。

基于ASFF-AAKR和CNN-BILSTM滚动轴承寿命预测

针对滚动轴承寿命预测精度低,构建健康指标困难的问题。提出了一种基于自适应特征融合(adaptively spatial feature fusion,ASFF)和自联想核回归模型(auto associative kernel regression,AAKR)与卷积神经网络(convolutional neural networks,CNN)和双向长短期记忆网络(bi-directional long-short term memory,BILSTM)的轴承剩余寿命预测模型。首先,在时域、频域和时频域提取多维特征,利用单调性和趋势性筛选敏感特征;其次利用ASFF-AAKR对敏感特征进行特征融合构建健康指标;最后,将健康指标输入到CNN和BILSTM中,实现对滚动轴承的寿命预测。结果表明:所构建的寿命预测模型优于其他模型,该方法具有更低的误差、寿命预测精度更高。

融合二次分解的深度学习模型在PM_(2.5)浓度预测中的应用

针对PM_(2.5)质量浓度时间序列呈非线性难以预测的特征,为了进一步提高PM_(2.5)质量浓度预测精确度,研究通过“分而治之”先分解再预测的思想,提出一种融合二次分解的PM_(2.5)质量浓度混合预测模型(Complete Ensemble Empirical Mode Decomposition with Adaptive Noise-Variational Mode Decomposition-Temporal Convolutional Network-Bi-directional Long Short-Term Memory,CEEMDAN-VMD-TCN-BiLSTM)。该模型先由递归特征消除(Recursive Feature Elimination,RFE)进行特征筛选,随后使用自适应噪声完备集合经验模态分解(Complete Ensemble Empirical Mode Decomposition with Adaptive Noise,CEEMDAN)将2013—2016年北京市PM_(2.5)质量浓度序列分解为一系列高低频模态分量并计算各分量样本熵,将样本熵由K-means聚类整合为新的分量,再由变分模态分解(Variational Mode Decomposition,VMD)方法进行二次分解。最后,将所有分量先经时间卷积网络(Temporal Convolutional Network,TCN)进行特征提取,并通过双向长短期记忆网络(Bi-directional Long Short-Term Memory,BiLSTM)预测,叠加各分量预测值即为最终预测结果。消融试验结果显示,该模型相比于单次CEEMDAN分解模型均方根误差E_(MAPE)降低19.312%,绝对误差E_(MAE)降低34.423%,百分比误差E_(MAPE)与希尔不等系数E_(TIC)分别减少40.465百分点和59.794%。由此可见,研究在引入VMD构成二次分解模型相比于单次分解模型的预测误差更小,精度更高,可为决策者在PM_(2.5)质量浓度预测与治理等工作提供一定参考。

基于AI的噪声环境下远距离高清音频采集研究

为提升远距离采集音频信号的强度,深度滤除音频信号噪声以提取有用音频部分,提出一种基于AI的噪声环境下远距离高清音频采集方法。构建远距离高清音频采集结构,分别通过模拟增益和数字增益技术进行音频信号增益处理,以提升音频信号强度。依据短时傅里叶变换提取音频增益信号频域特征,输入到长短期记忆网络中,实现音频信号深度噪声去除,得到高清音频频域信息;再通过短时傅里叶逆变换处理该信号,实现音频信号重构,最终达到噪声环境下远距离高清音频采集的目的。实验验证结果表明:依据音频信号增益能够有效提升采集音频信号的强度,并避免信号受距离、噪声影响而逐渐衰减,继而有效滤除音频信号噪声数据,提取其中有用的音频信号,确保音频信号高清度;且最终采集音频信号信噪比均高于18 dB,可懂度均高于97%,有效验证了所提方法的有效性和准确性。

基于LSTM-DDPG的再入制导方法

针对现有基于深度确定性策略梯度(deep deterministic policy gradient,DDPG)算法的再入制导方法计算精度较差,对强扰动条件适应性不足等问题,在DDPG算法训练框架的基础上,提出一种基于长短期记忆-DDPG(long short term memory-DDPG,LSTM-DDPG)的再入制导方法。该方法采用纵、侧向制导解耦设计思想,在纵向制导方面,首先针对再入制导问题构建强化学习所需的状态、动作空间;其次,确定决策点和制导周期内的指令计算策略,并设计考虑综合性能的奖励函数;然后,引入LSTM网络构建强化学习训练网络,进而通过在线更新策略提升算法的多任务适用性;侧向制导则采用基于横程误差的动态倾侧反转方法,获得倾侧角符号。以美国超音速通用飞行器(common aero vehicle-hypersonic,CAV-H)再入滑翔为例进行仿真,结果表明:与传统数值预测-校正方法相比,所提制导方法具有相当的终端精度和更高的计算效率优势;与现有基于DDPG算法的再入制导方法相比,所提制导方法具有相当的计算效率以及更高的终端精度和鲁棒性。