Predicting and Curing Depression Using Long Short Term Memory and Global Vector

In today’s world, there are many people suffering from mentalhealth problems such as depression and anxiety. If these conditions are notidentified and treated early, they can get worse quickly and have far-reachingnegative effects. Unfortunately, many people suffering from these conditions,especially depression and hypertension, are unaware of their existence until theconditions become chronic. Thus, this paper proposes a novel approach usingBi-directional Long Short-Term Memory (Bi-LSTM) algorithm and GlobalVector (GloVe) algorithm for the prediction and treatment of these conditions.Smartwatches and fitness bands can be equipped with these algorithms whichcan share data with a variety of IoT devices and smart systems to betterunderstand and analyze the user’s condition. We compared the accuracy andloss of the training dataset and the validation dataset of the two modelsnamely, Bi-LSTM without a global vector layer and with a global vector layer.It was observed that the model of Bi-LSTM without a global vector layer hadan accuracy of 83%,while Bi-LSTMwith a global vector layer had an accuracyof 86% with a precision of 86.4%, and an F1 score of 0.861. In addition toproviding basic therapies for the treatment of identified cases, our model alsohelps prevent the deterioration of associated conditions, making our methoda real-world solution.

Tool Health Condition Recognition Method for High Speed Milling of Titanium Alloy Based on Principal Component Analysis (PCA) and Long Short Term Memory (LSTM)

The healthy condition of the milling tool has a very high impact on the machining quality of the titanium components.Therefore,it is important to recognize the healthy condition of the tool and replace the damaged cutter at the right time.In order to recognize the health condition of the milling cutter,a method based on the long short term memory(LSTM)was proposed to recognize tool health state in this paper.The various signals collected in the tool wear experiments were analyzed by time-domain statistics,and then the extracted data were generated by principal component analysis(PCA)method.The preprocessed data extracted by PCA is transmitted to the LSTM model for recognition.Compared with back propagation neural network(BPNN)and support vector machine(SVM),the proposed method can effectively utilize the time-domain regulation in the data to achieve higher recognition speed and accuracy.

一种基于long short-term memory的唇语识别方法

唇动视觉信息是说话内容的重要载体。受嘴唇外观、背景信息和说话习惯等影响,即使说话者说相同的内容,唇动视觉信息也会相差很大。为解决唇语视觉信息多样性的问题,提出一种基于long short-term memory(LSTM)的新的唇语识别方法。以往大多数的方法从嘴唇外表信息入手。本方法用嘴唇关键点坐标描述嘴唇形变信息作为唇语视频的特征,它具有类内一致性和类间区分性的特点。然后利用LSTM对特征进行时序编码,它能学习具有区分性和泛化性的空间-时序特征。在公开的唇语数据集GRID、MIRACL-VC和Oulu VS上对本方法做了针对分割的单词或短语的说话者独立的唇语识别评估。在GRID和MIRACL-VC上,本方法的准确率比传统方法至少高30%;在Oulu VS上,本方法的准确率接近于最优结果。以上实验结果表明,本文提出的基于LSTM的唇语识别方法有效地解决了唇语视觉信息多样性的问题。

Conditional Random Field Tracking Model Based on a Visual Long Short Term Memory Network

In dense pedestrian tracking,frequent object occlusions and close distances between objects cause difficulty when accurately estimating object trajectories.In this study,a conditional random field tracking model is established by using a visual long short term memory network in the three-dimensional(3D)space and the motion estimations jointly performed on object trajectory segments.Object visual field information is added to the long short term memory network to improve the accuracy of the motion related object pair selection and motion estimation.To address the uncertainty of the length and interval of trajectory segments,a multimode long short term memory network is proposed for the object motion estimation.The tracking performance is evaluated using the PETS2009 dataset.The experimental results show that the proposed method achieves better performance than the tracking methods based on the independent motion estimation.

Long Short-Term Memory Recurrent Neural Network-Based Acoustic Model Using Connectionist Temporal Classification on a Large-Scale Training Corpus

A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a forced aligned Hidden Markov Model(HMM) state sequence obtained from the GMM-based acoustic model. Therefore, it requires a long computation time for training both the GMM-based acoustic model and a deep learning-based acoustic model. In order to solve this problem, an acoustic model using CTC algorithm is proposed. CTC algorithm does not require the GMM-based acoustic model because it does not use the forced aligned HMM state sequence. However, previous works on a LSTM RNN-based acoustic model using CTC used a small-scale training corpus. In this paper, the LSTM RNN-based acoustic model using CTC is trained on a large-scale training corpus and its performance is evaluated. The implemented acoustic model has a performance of 6.18% and 15.01% in terms of Word Error Rate(WER) for clean speech and noisy speech, respectively. This is similar to a performance of the acoustic model based on the hybrid method.

Short-Term Relay Quality Prediction Algorithm Based on Long and Short-Term Memory

The fraction defective of semi-finished products is predicted to optimize the process of relay production lines, by which production quality and productivity are increased, and the costs are decreased. The process parameters of relay production lines are studied based on the long-and-short-term memory network. Then, the Keras deep learning framework is utilized to build up a short-term relay quality prediction algorithm for the semi-finished product. A simulation model is used to study prediction algorithm. The simulation results show that the average prediction absolute error of the fraction is less than 5%. This work displays great application potential in the relay production lines.

Analyses of fear memory in Arc/Arg3.1-deficient mice: intact short-term memory and impaired long-term and remote memory

Activity-regulated cytoskeleton-associated protein (Arc/Arg3.1) was originally identified in patients with seizures. It is densely distributed in the hip-pocampus and amygdala in particular. Because the expression of Arc/Arg3.1 is regulated by nerve in-puts, it is thought to be an immediate early gene. As shown both in vitro and in vivo, Arc/Arg3.1 is in-volved in synaptic consolidation and regulates some forms of learning and memory in rats and mice [1,2]. Furthermore, a recent study suggests that Arc/Arg3.1 may play a significant role in signal transmission via AMPA-type glutamate receptors [3-5]. Therefore, we conducted a detailed analysis of fear memory in Arc/Arg3.1-deficient mice. As previously reported, the knockout animals exhib-ited impaired fear memory in both contextual and cued test situations. Although Arc/Arg3.1-deficient mice showed almost the same performance as wild-type littermates 4 hr after a conditioning trial, their performance was impaired in the retention test after 24 hr or longer, either with or without reconsolidation. Immunohistochemical analyses showed an abnormal density of GluR1 in the hip-pocampus of Arc/Arg3.1-deficient mice;however, an application of AMPA potentiator did not improve memory performance in the mutant mice. Memory impairment in Arc/Arg3.1-deficient mice is so ro-bust that the mice provide a useful tool for devel-oping treatments for memory impairment.

State of Health Estimation of Lithium-Ion Batteries Using Support Vector Regression and Long Short-Term Memory

Lithium-ion batteries are the most widely accepted type of battery in the electric vehicle industry because of some of their positive inherent characteristics. However, the safety problems associated with inaccurate estimation and prediction of the state of health of these batteries have attracted wide attention due to the adverse negative effect on vehicle safety. In this paper, both machine and deep learning models were used to estimate the state of health of lithium-ion batteries. The paper introduces the definition of battery health status and its importance in the electric vehicle industry. Based on the data preprocessing and visualization analysis, three features related to actual battery capacity degradation are extracted from the data. Two learning models, SVR and LSTM were employed for the state of health estimation and their respective results are compared in this paper. The mean square error and coefficient of determination were the two metrics for the performance evaluation of the models. The experimental results indicate that both models have high estimation results. However, the metrics indicated that the SVR was the overall best model.

基于注意力机制LSTM的电离层TEC预测

电离层总电子含量(Total Electron Content,TEC)的监测与预报是空间环境研究的重要内容,对卫星通讯和导航定位等有重要意义.TEC值影响因素较多,很难确定精确物理模型来对其进行预测.本文设计了基于注意力机制的LSTM模型(Att-LSTM),采用过去24小时TEC观测数据对未来TEC进行预测.选择北半球东经100°上,每2.5°纬度选择一个位置,共计36个位置来验证本文提出模型的性能,并与主流的深度学习模型如DNN、RNN、LSTM进行对比实验.取得了如下成果:(1)在选定的36个地区未来2小时单点预测上,基于本文的Att-LSTM模型的TEC预测性能明显优于其他对比模型;(2)讨论了纬度对Att-LSTM预测未来2小时TEC值时性能的影响,发现在北纬0°到60°之间,Att-LSTM预测性能随着纬度的升高而略有降低,在北纬62.5°~87.5°之间,模型预测性能出现扰动,预测效果略差;(3)讨论了磁暴期和磁静期模型的预测性能,发现无论是磁暴期还是磁静期,本文模型预测性能均较好;(4)还讨论了对未来多时点预测效果,实验结果表明,本文所提出的模型对未来2、4个小时的预测拟合度R-Square均超过0.95,预测结果比较可靠,对未来6、8、10个小时预测拟合度最高为0.7934,预测拟合度R-Square下降迅速,预测结果不可靠.

基于ConvLSTM-CNN预测太平洋长鳍金枪鱼时空分布趋势

海洋渔场的变动由空间与环境因子共同驱动,渔场时空演变信息的精准预测是海洋捕捞的关键。本研究利用1995-2018年太平洋海域长鳍金枪鱼(Thunnus alalunga)的渔业生产统计数据,结合同期海洋环境数据包括海表面温度(Sea Surface Temperature,SST)、海表面盐度(Sea Surface Salinity,SSS)、初级生产力(Primary Productivity,PP)和溶解氧浓度(Dissolved Oxygen Concentration,DO),提出了一种融合卷积长短期记忆网络(Convolutional Long Short-Term Memory Networks,ConvLSTM)和卷积神经网络(Convolutional Neural Networks,CNN)的渔场时空分布预测模型。该模型引入特征提取模块,对时空因子进行编码,提取时空特征信息,同时采用CNN提取海洋环境变量的抽象特征,采用ConvLSTM提取渔业数据的高层时空关联信息,最后融合多种特征对渔场时空演变趋势进行预测。结果表明,模型的均方根误差为0.1036,较随机森林、BP神经网络和长短期记忆网络(Long Short Term Memory,LSTM)等传统渔场预报模型的预测误差降低15%~40%,预测的高产渔区与实际作业的高渔获量区匹配度为89%。该研究构建的渔场时空预测模型能够准确地预测出太平洋长鳍金枪鱼的时空分布,为太平洋长鳍金枪鱼的延绳钓渔业提供科学参考依据。

基于CEEMD-SE的CNN&LSTM-GRU短期风电功率预测

为进一步提升短期风电功率的预测精度,提出了一种基于互补集合经验模态分解-样本熵(complementary ensemble empirical mode decomposition-sample entropy,CEEMD-SE)的卷积神经网络(convolutional neural network,CNN)和长短期记忆-门控循环单元(longshorttermmemory-gatedrecurrentunit,LSTM-GRU)的短期风电功率预测模型。首先,利用互补集合经验模态分解将原始风电功率序列分解为若干本征模态函数(intrinsic mode function,IMF)分量和一个残差(residual,RES)分量,利用样本熵算法将相近的分量进行重构;其次,搭建卷积神经网络和长短期记忆网络的并行网络结构,提取数据的局部特征和时序特征,并将特征融合后输入门控循环单元网络中进行学习预测;最后,通过算例进行验证,结果表明采用该模型后预测精度得到了有效提升,其均方根误差降低了15.06%、平均绝对误差降低了15.22%、决定系数提高了1.91%。

结合太阳辐射量计算与CNN-LSTM组合的光伏功率预测方法研究

为了提高模型预测性能,提出一种综合太阳辐射模型及深度学习的光伏功率预测模型。首先,利用太阳辐射机理建立太阳辐射模型(SRM),估算出水平面上总辐射值,再由斜面辐照度转换方法计算出光伏组件所接收的斜面辐射值。其次,通过皮尔逊相关分析法筛选出对光伏功率影响较大的主要因素,将斜面辐射计算值及主要影响因素作为输入,采用卷积神经网络(CNN)和长短期记忆网络(LSTM)建立光伏功率SRM-CNN-LSTM预测模型。分别利用春夏秋冬四季典型日的数据开展对比实验,结果表明:与几种其他方法相比,该文方法具有更好的预测效果。

基于Encoder-Decoder LSTM的船舶轨迹预测方法

船舶轨迹预测的准确性是预警事故和确保安全航行的关键,但精度和稳定性是目前亟待解决的问题。为了应对这一挑战,提出一种基于Encoder-Decoder LSTM的船舶轨迹预测方法。首先对船舶AIS轨迹数据进行去噪、分段、插值、停留点检测和归一化等预处理,提取船舶的航行轨迹。然后构建了一种基于Encoder-Decoder LSTM架构的船舶轨迹预测模型,并对模型参数进行初始化。最后使用长江江苏段天生港水域渡轮的真实AIS数据对提出的模型进行训练和验证,并与其他广泛使用的轨迹预测方法进行比较。定量分析表明,该方法可实现对船舶轨迹较为准确的预测,且所预测轨迹具有一定的参考价值。

基于改进麻雀搜索算法优化LSTM的滚动轴承故障诊断

为了对滚动轴承的工作状态及故障类别进行准确的诊断,本文采用长短时记忆(LSTM)神经网络作为分类器对滚动轴承数据集进行分类诊断。首先,从滚动轴承原始运行振动信号中提取时域和频域特征参数,组成具有高维特征参数的数据集;使用核主成分分析(KPCA)方法对高维特征集进行降维处理,选取重要性程度高的特征构成输入特征向量。然后,针对LSTM神经网络在滚动轴承故障诊断中存在的超参数难以确定的问题,提出一种基于自适应t分布策略的麻雀搜索算法优化LSTM神经网络的故障诊断方法(tSSA–LSTM)。最后,使用凯斯西储大学滚动轴承数据中心的数据进行故障诊断精度测试、泛化性能测试及噪声环境下故障诊断性能测试等多个仿真实验,并将本文提出的诊断模型与麻雀搜索算法优化长短时记忆神经网络(SSA–LSTM)、遗传算法优化长短时记忆神经网络(GA–LSTM)、粒子群算法优化长短时记忆神经网络(PSO–LSTM)及传统LSTM诊断模型进行对比。结果表明:tSSA可以更有效地对LSTM的隐含层神经元数量、周期次数、学习率等超参数进行合理优化;所提方法的平均诊断准确率达到98.86%,交叉验证平均诊断结果为98.57%;所提方法在噪声干扰下的故障诊断准确率也优于对比方法。因此,本文提出的tSSA–LSTM模型不仅可以更精准地诊断滚动轴承故障状态,而且具有更强的泛化能力及抗干扰能力,有效地提高了滚动轴承故障诊断的性能。

EEMD与LSTM在轴承剩余寿命预测中的应用

剩余使用寿命(RUL)预测是实现装备健康管理与预测性维护的最主要技术手段之一,为了准确预测轴承的剩余使用寿命,提出了一种基于集合经验模态分解(EEMD)和长短时记忆网络(LSTM)的轴承剩余寿命预测方法。首先,对采集到的振动信号做时域、频域及时频分析,同时记录相应特征;进而,筛选特征,通过EEMD对振动信号予以分解并重构;最后,通过LSTM结合经过处理的信号构建健康特征指标。通过实验证明了该方法能有效的预测出轴承的剩余寿命,且有较高的预测精度。

基于BERT-BiLSTM-CRF模型的畜禽疫病文本分词研究

针对畜禽疫病文本语料匮乏、文本内包含大量疫病名称及短语等未登录词问题,提出了一种结合词典匹配的BERT-BiLSTM-CRF畜禽疫病文本分词模型。以羊疫病为研究对象,构建了常见疫病文本数据集,将其与通用语料PKU结合,利用BERT(Bidirectional encoder representation from transformers)预训练语言模型进行文本向量化表示;通过双向长短时记忆网络(Bidirectional long short-term memory network,BiLSTM)获取上下文语义特征;由条件随机场(Conditional random field,CRF)输出全局最优标签序列。基于此,在CRF层后加入畜禽疫病领域词典进行分词匹配修正,减少在分词过程中出现的疫病名称及短语等造成的歧义切分,进一步提高了分词准确率。实验结果表明,结合词典匹配的BERT-BiLSTM-CRF模型在羊常见疫病文本数据集上的F1值为96.38%,与jieba分词器、BiLSTM-Softmax模型、BiLSTM-CRF模型、未结合词典匹配的本文模型相比,分别提升11.01、10.62、8.3、0.72个百分点,验证了方法的有效性。与单一语料相比,通用语料PKU和羊常见疫病文本数据集结合的混合语料,能够同时对畜禽疫病专业术语及疫病文本中常用词进行准确切分,在通用语料及疫病文本数据集上F1值都达到95%以上,具有较好的模型泛化能力。该方法可用于畜禽疫病文本分词。

基于AM-LSTM的飞行区航空器滑行轨迹预测与冲突识别

为解决航空器点源定位难以有效预测而引发冲突风险愈来愈多的问题,构建基于注意力机制(AM)和长短期记忆网络(LSTM)的时间序列轨迹预测模型AM-LSTM,预测未来短时间内飞行区航空器的瞬时点源位置;在此基础上,根据航空器型号和滑行航向对其进行轮廓扩展,以航空器速度作为安全距离权重,通过射线法实现轮廓冲突的判定;并以乌鲁木齐地窝堡机场为例进行验证,利用训练完成的轨迹预测模型预测飞行区航空器滑行轨迹,以识别航空器轮廓间的滑行冲突。结果表明:AM-LSTM预测模型能够准确预测飞行区航空器运动轨迹。未来3 s内轨迹位置预测的平均位移误差为1.05 m,轨迹点位置预测精准性可达94.37%,故能在轨迹预测的基础上精确识别滑行冲突风险,有利于保障飞行区的安全运行。

Prophet-LSTM组合模型在运输航空征候预测中的应用

为准确预测中国运输航空征候万时率,提出了一种将时间序列模型和神经网络模型组合的预测方法。首先,利用2008年1月—2020年12月的运输航空征候万时率数据建立Prophet模型,使用RStudio软件进行模型拟合,获取运输航空征候万时率的线性部分;其次,利用长短期记忆网络(Long Short-Term Memory,LSTM)建模,获取运输航空征候万时率的非线性部分;最后,利用方差倒数法建立Prophet-LSTM组合模型,使用建立的组合模型对2021年1—12月运输航空征候万时率进行预测,将预测结果与实际值进行对比验证。结果表明,Prophet-LSTM组合模型的EMA、EMAP、ERMS分别为0.0973、16.1285%、0.1287。相较于已有的自回归移动平均(Auto Regression Integrated Moving Average,ARIMA)+反向传播神经网络(Back Propagation Neural Network,BPNN)组合模型和GM(1,1)+ARIMA+LSTM组合模型,Prophet-LSTM组合模型的EMA、EMAP、ERMS分别减小了0.0259、10.4874百分点、0.0143和0.0128、2.0599百分点、0.0086,验证了Prophet-LSTM组合模型的预测精度更高,性能更优良。

基于GA-LSTM自适应卡尔曼滤波的路面不平度识别

准确、快速地识别出车辆当前行驶的路面激励信息,是实现智能底盘控制进而保证车辆平顺性的关键。针对传统路面不平度识别算法准确率低、自适应性差等问题,提出了基于遗传算法(genetic algorithm,GA)优化长短期记忆神经网络(long short-term memory networks,LSTM)自适应卡尔曼滤波的路面不平度识别算法。基于2自由度车辆悬架模型,通过灰色关联法选择LSTM神经网络的特征输入变量,并采用GA优化LSTM神经网络的模型参数以准确识别路面等级,并据此实时更新卡尔曼滤波器算法中的噪声矩阵,实现了在复杂路况下对路面不平度的自适应识别。仿真和试验研究表明,所提出的基于GA-LSTM自适应卡尔曼滤波算法能够快速准确的识别路面不平度与路面等级,与传统卡尔曼滤波算法相比,相关系数、均方根误差和最大绝对误差分别提高3.11%、37.5%和51.2%,表明所提算法对复杂工况具有很好的自适应能力。

基于VMD-BiLSTM-WOA的短期风电功率预测

风力发电对于解决全球能源短缺问题有重要意义,准确预测风电功率有助于风电并网的合理调度和可靠的电网运行.文章提出了一种基于变分模态分解(Variational Mode Decomposition, VMD)、双向长短期记忆网络(Bidirectional Long Short-term Memory Network, BiLSTM)以及鲸鱼优化算法(Whale Optimization Algorithm, WOA)的混合深度学习模型,以用于短期风电功率预测.首先,VMD将原始风电功率分解为多个子模态,有效减少了序列的波动性;然后对每个子模态分别建立BiLSTM模型,使用WOA对BiLSTM中的参数进行优化,以提高混合模型的效率和预测性能;最后将各个子模型的结果叠加得到最终预测结果.在实验中通过建立不同的比较模型来说明改进策略的有效性和优越性,结果表明所提的混合模型在风电功率预测中具有较高的预测精度.