The problems in equipment fault detection include data dimension explosion,computational complexity,low detection accuracy,etc.To solve these problems,a device anomaly detection algorithm based on enhanced long short-...The problems in equipment fault detection include data dimension explosion,computational complexity,low detection accuracy,etc.To solve these problems,a device anomaly detection algorithm based on enhanced long short-term memory(LSTM)is proposed.The algorithm first reduces the dimensionality of the device sensor data by principal component analysis(PCA),extracts the strongly correlated variable data among the multidimensional sensor data with the lowest possible information loss,and then uses the enhanced stacked LSTM to predict the extracted temporal data,thus improving the accuracy of anomaly detection.To improve the efficiency of the anomaly detection,a genetic algorithm(GA)is used to adjust the magnitude of the enhancements made by the LSTM model.The validation of the actual data from the pumps shows that the algorithm has significantly improved the recall rate and the detection speed of device anomaly detection,with the recall rate of 97.07%,which indicates that the algorithm is effective and efficient for device anomaly detection in the actual production environment.展开更多
The rapid development of unmanned aerial vehicle(UAV) swarm, a new type of aerial threat target, has brought great pressure to the air defense early warning system. At present, most of the track correlation algorithms...The rapid development of unmanned aerial vehicle(UAV) swarm, a new type of aerial threat target, has brought great pressure to the air defense early warning system. At present, most of the track correlation algorithms only use part of the target location, speed, and other information for correlation.In this paper, the artificial neural network method is used to establish the corresponding intelligent track correlation model and method according to the characteristics of swarm targets.Precisely, a route correlation method based on convolutional neural networks (CNN) and long short-term memory (LSTM)Neural network is designed. In this model, the CNN is used to extract the formation characteristics of UAV swarm and the spatial position characteristics of single UAV track in the formation,while the LSTM is used to extract the time characteristics of UAV swarm. Experimental results show that compared with the traditional algorithms, the algorithm based on CNN-LSTM neural network can make full use of multiple feature information of the target, and has better robustness and accuracy for swarm targets.展开更多
针对铣刀磨损量预测时精度低的问题,提出一种基于黑寡妇算法(BWO)优化的长短期记忆神经网络(LSTM)与AdaBoost集成学习算法相结合的铣刀磨损量预测方法。在铣刀磨损振动信号中提取时域、频域以及时频域多域特征。通过BWO算法优化LSTM的...针对铣刀磨损量预测时精度低的问题,提出一种基于黑寡妇算法(BWO)优化的长短期记忆神经网络(LSTM)与AdaBoost集成学习算法相结合的铣刀磨损量预测方法。在铣刀磨损振动信号中提取时域、频域以及时频域多域特征。通过BWO算法优化LSTM的核心参数,并将优化后的LSTM网络与AdaBoost算法进行结合,构建铣刀磨损量预测模型。最后用PHM Society 2010铣刀全寿命周期的振动数据进行实验。研究结果表明:所提方法能够有效地预测出铣刀磨损量变化值,优化后模型的平均绝对误差百分比为3.436%、均方根误差为6.471、决定系数R^(2)为0.935。该方法能够获得准确率更高的铣刀磨损量预测值,预测效率更高。展开更多
This paper introduces the time-frequency analyzed long short-term memory(TF-LSTM) neural network method for jamming signal recognition over the Global Navigation Satellite System(GNSS) receiver. The method introduces ...This paper introduces the time-frequency analyzed long short-term memory(TF-LSTM) neural network method for jamming signal recognition over the Global Navigation Satellite System(GNSS) receiver. The method introduces the long shortterm memory(LSTM) neural network into the recognition algorithm and combines the time-frequency(TF) analysis for signal preprocessing. Five kinds of navigation jamming signals including white Gaussian noise(WGN), pulse jamming, sweep jamming, audio jamming, and spread spectrum jamming are used as input for training and recognition. Since the signal parameters and quantity are unknown in the actual scenario, this work builds a data set containing multiple kinds and parameters jamming to train the TF-LSTM. The performance of this method is evaluated by simulations and experiments. The method has higher recognition accuracy and better robustness than the existing methods, such as LSTM and the convolutional neural network(CNN).展开更多
To fully make use of information from different representation subspaces,a multi-head attention-based long short-term memory(LSTM)model is proposed in this study for speech emotion recognition(SER).The proposed model ...To fully make use of information from different representation subspaces,a multi-head attention-based long short-term memory(LSTM)model is proposed in this study for speech emotion recognition(SER).The proposed model uses frame-level features and takes the temporal information of emotion speech as the input of the LSTM layer.Here,a multi-head time-dimension attention(MHTA)layer was employed to linearly project the output of the LSTM layer into different subspaces for the reduced-dimension context vectors.To provide relative vital information from other dimensions,the output of MHTA,the output of feature-dimension attention,and the last time-step output of LSTM were utilized to form multiple context vectors as the input of the fully connected layer.To improve the performance of multiple vectors,feature-dimension attention was employed for the all-time output of the first LSTM layer.The proposed model was evaluated on the eNTERFACE and GEMEP corpora,respectively.The results indicate that the proposed model outperforms LSTM by 14.6%and 10.5%for eNTERFACE and GEMEP,respectively,proving the effectiveness of the proposed model in SER tasks.展开更多
针对光伏发电功率存在随机波动性的问题,提出基于变分模态分解(variational mode decomposition,VMD)和改进麻雀搜索算法(improved sparrow search algorithm,ISSA)优化长短期记忆(long short term memory,LSTM)神经网络的短期光伏发电...针对光伏发电功率存在随机波动性的问题,提出基于变分模态分解(variational mode decomposition,VMD)和改进麻雀搜索算法(improved sparrow search algorithm,ISSA)优化长短期记忆(long short term memory,LSTM)神经网络的短期光伏发电功率预测方法。首先,通过VMD算法将多维光伏特征数据分解为若干不同频率的本征模态和残差分量,以降低原始序列的非平稳性;然后,采用ISSA对LSTM神经网络超参数进行全局寻优,建立了不同模态序列分量下的ISSA-LSTM组合模型;最后,使用训练好的组合模型对各分解的子序列模态特征分量进行多维预测,并将各层模态预测序列叠加组合成最终的输出结果。仿真结果表明,构建的VMD-ISSA-LSTM组合模型相较于常规的短期光伏发电功率预测模型,具有更强的鲁棒性和高精度性。展开更多
水声换能器是水声传感系统的核心部件,其性能直接影响系统的灵敏度、精度和可靠性。然而,传统的水声换能器参数测试方法存在数据处理量过大和算法精度较低的问题。为此,本文提出了一种基于I-GWO-LSTM(improved-grey wolf optimization a...水声换能器是水声传感系统的核心部件,其性能直接影响系统的灵敏度、精度和可靠性。然而,传统的水声换能器参数测试方法存在数据处理量过大和算法精度较低的问题。为此,本文提出了一种基于I-GWO-LSTM(improved-grey wolf optimization algorithm-long short-term memory)的水声换能器参数预测模型。该模型利用改进灰狼优化算法优化长短期记忆网络模型的参数,只需要测量少量数据点就可以实现对水声换能器等效电路元件参数的高精度预测。通过MATLAB进行仿真实验,验证了该模型在水声换能器参数预测方面具有较高的准确性和稳定性。展开更多
基金National Key R&D Program of China(No.2020YFB1707700)。
文摘The problems in equipment fault detection include data dimension explosion,computational complexity,low detection accuracy,etc.To solve these problems,a device anomaly detection algorithm based on enhanced long short-term memory(LSTM)is proposed.The algorithm first reduces the dimensionality of the device sensor data by principal component analysis(PCA),extracts the strongly correlated variable data among the multidimensional sensor data with the lowest possible information loss,and then uses the enhanced stacked LSTM to predict the extracted temporal data,thus improving the accuracy of anomaly detection.To improve the efficiency of the anomaly detection,a genetic algorithm(GA)is used to adjust the magnitude of the enhancements made by the LSTM model.The validation of the actual data from the pumps shows that the algorithm has significantly improved the recall rate and the detection speed of device anomaly detection,with the recall rate of 97.07%,which indicates that the algorithm is effective and efficient for device anomaly detection in the actual production environment.
文摘The rapid development of unmanned aerial vehicle(UAV) swarm, a new type of aerial threat target, has brought great pressure to the air defense early warning system. At present, most of the track correlation algorithms only use part of the target location, speed, and other information for correlation.In this paper, the artificial neural network method is used to establish the corresponding intelligent track correlation model and method according to the characteristics of swarm targets.Precisely, a route correlation method based on convolutional neural networks (CNN) and long short-term memory (LSTM)Neural network is designed. In this model, the CNN is used to extract the formation characteristics of UAV swarm and the spatial position characteristics of single UAV track in the formation,while the LSTM is used to extract the time characteristics of UAV swarm. Experimental results show that compared with the traditional algorithms, the algorithm based on CNN-LSTM neural network can make full use of multiple feature information of the target, and has better robustness and accuracy for swarm targets.
文摘针对铣刀磨损量预测时精度低的问题,提出一种基于黑寡妇算法(BWO)优化的长短期记忆神经网络(LSTM)与AdaBoost集成学习算法相结合的铣刀磨损量预测方法。在铣刀磨损振动信号中提取时域、频域以及时频域多域特征。通过BWO算法优化LSTM的核心参数,并将优化后的LSTM网络与AdaBoost算法进行结合,构建铣刀磨损量预测模型。最后用PHM Society 2010铣刀全寿命周期的振动数据进行实验。研究结果表明:所提方法能够有效地预测出铣刀磨损量变化值,优化后模型的平均绝对误差百分比为3.436%、均方根误差为6.471、决定系数R^(2)为0.935。该方法能够获得准确率更高的铣刀磨损量预测值,预测效率更高。
基金supported by the National Natural Science Foundation of China (62003354)。
文摘This paper introduces the time-frequency analyzed long short-term memory(TF-LSTM) neural network method for jamming signal recognition over the Global Navigation Satellite System(GNSS) receiver. The method introduces the long shortterm memory(LSTM) neural network into the recognition algorithm and combines the time-frequency(TF) analysis for signal preprocessing. Five kinds of navigation jamming signals including white Gaussian noise(WGN), pulse jamming, sweep jamming, audio jamming, and spread spectrum jamming are used as input for training and recognition. Since the signal parameters and quantity are unknown in the actual scenario, this work builds a data set containing multiple kinds and parameters jamming to train the TF-LSTM. The performance of this method is evaluated by simulations and experiments. The method has higher recognition accuracy and better robustness than the existing methods, such as LSTM and the convolutional neural network(CNN).
基金The National Natural Science Foundation of China(No.61571106,61633013,61673108,81871444).
文摘To fully make use of information from different representation subspaces,a multi-head attention-based long short-term memory(LSTM)model is proposed in this study for speech emotion recognition(SER).The proposed model uses frame-level features and takes the temporal information of emotion speech as the input of the LSTM layer.Here,a multi-head time-dimension attention(MHTA)layer was employed to linearly project the output of the LSTM layer into different subspaces for the reduced-dimension context vectors.To provide relative vital information from other dimensions,the output of MHTA,the output of feature-dimension attention,and the last time-step output of LSTM were utilized to form multiple context vectors as the input of the fully connected layer.To improve the performance of multiple vectors,feature-dimension attention was employed for the all-time output of the first LSTM layer.The proposed model was evaluated on the eNTERFACE and GEMEP corpora,respectively.The results indicate that the proposed model outperforms LSTM by 14.6%and 10.5%for eNTERFACE and GEMEP,respectively,proving the effectiveness of the proposed model in SER tasks.
文摘针对光伏发电功率存在随机波动性的问题,提出基于变分模态分解(variational mode decomposition,VMD)和改进麻雀搜索算法(improved sparrow search algorithm,ISSA)优化长短期记忆(long short term memory,LSTM)神经网络的短期光伏发电功率预测方法。首先,通过VMD算法将多维光伏特征数据分解为若干不同频率的本征模态和残差分量,以降低原始序列的非平稳性;然后,采用ISSA对LSTM神经网络超参数进行全局寻优,建立了不同模态序列分量下的ISSA-LSTM组合模型;最后,使用训练好的组合模型对各分解的子序列模态特征分量进行多维预测,并将各层模态预测序列叠加组合成最终的输出结果。仿真结果表明,构建的VMD-ISSA-LSTM组合模型相较于常规的短期光伏发电功率预测模型,具有更强的鲁棒性和高精度性。
