Attention-Based Residual Dense Shrinkage Network for ECG Denoising

Electrocardiogram(ECG)signal is one of the noninvasive physiological measurement techniques commonly usedin cardiac diagnosis.However,in real scenarios,the ECGsignal is susceptible to various noise erosion,which affectsthe subsequent pathological analysis.Therefore,the effective removal of the noise from ECG signals has becomea top priority in cardiac diagnostic research.Aiming at the problem of incomplete signal shape retention andlow signal-to-noise ratio(SNR)after denoising,a novel ECG denoising network,named attention-based residualdense shrinkage network(ARDSN),is proposed in this paper.Firstly,the shallow ECG characteristics are extractedby a shallow feature extraction network(SFEN).Then,the residual dense shrinkage attention block(RDSAB)isused for adaptive noise suppression.Finally,feature fusion representation(FFR)is performed on the hierarchicalfeatures extracted by a series of RDSABs to reconstruct the de-noised ECG signal.Experiments on the MIT-BIHarrhythmia database and MIT-BIH noise stress test database indicate that the proposed scheme can effectively resistthe interference of different sources of noise on the ECG signal.

Rockburst Intensity Grade Prediction Model Based on Batch Gradient Descent and Multi-Scale Residual Deep Neural Network

Rockburst is a phenomenon in which free surfaces are formed during excavation,which subsequently causes the sudden release of energy in the construction of mines and tunnels.Light rockburst only peels off rock slices without ejection,while severe rockburst causes casualties and property loss.The frequency and degree of rockburst damage increases with the excavation depth.Moreover,rockburst is the leading engineering geological hazard in the excavation process,and thus the prediction of its intensity grade is of great significance to the development of geotechnical engineering.Therefore,the prediction of rockburst intensity grade is one problem that needs to be solved urgently.By comprehensively considering the occurrence mechanism of rockburst,this paper selects the stress index(σθ/σc),brittleness index(σ_(c)/σ_(t)),and rock elastic energy index(Wet)as the rockburst evaluation indexes through the Spearman coefficient method.This overcomes the low accuracy problem of a single evaluation index prediction method.Following this,the BGD-MSR-DNN rockburst intensity grade prediction model based on batch gradient descent and a multi-scale residual deep neural network is proposed.The batch gradient descent(BGD)module is used to replace the gradient descent algorithm,which effectively improves the efficiency of the network and reduces the model training time.Moreover,the multi-scale residual(MSR)module solves the problem of network degradation when there are too many hidden layers of the deep neural network(DNN),thus improving the model prediction accuracy.The experimental results reveal the BGDMSR-DNN model accuracy to reach 97.1%,outperforming other comparable models.Finally,actual projects such as Qinling Tunnel and Daxiangling Tunnel,reached an accuracy of 100%.The model can be applied in mines and tunnel engineering to realize the accurate and rapid prediction of rockburst intensity grade.

End-to-End Auto-Encoder System for Deep Residual Shrinkage Network for AWGN Channels

With the rapid development of deep learning methods, the data-driven approach has shown powerful advantages over the model-driven one. In this paper, we propose an end-to-end autoencoder communication system based on Deep Residual Shrinkage Networks (DRSNs), where neural networks (DNNs) are used to implement the coding, decoding, modulation and demodulation functions of the communication system. Our proposed autoencoder communication system can better reduce the signal noise by adding an “attention mechanism” and “soft thresholding” modules and has better performance at various signal-to-noise ratios (SNR). Also, we have shown through comparative experiments that the system can operate at moderate block lengths and support different throughputs. It has been shown to work efficiently in the AWGN channel. Simulation results show that our model has a higher Bit-Error-Rate (BER) gain and greatly improved decoding performance compared to conventional modulation and classical autoencoder systems at various signal-to-noise ratios.

Ash Detection of Coal Slime Flotation Tailings Based on Chromatographic Filter Paper Sampling and Multi-Scale Residual Network

The detection of ash content in coal slime flotation tailings using deep learning can be hindered by various factors such as foam,impurities,and changing lighting conditions that disrupt the collection of tailings images.To address this challenge,we present a method for ash content detection in coal slime flotation tailings.This method utilizes chromatographic filter paper sampling and a multi-scale residual network,which we refer to as MRCN.Initially,tailings are sampled using chromatographic filter paper to obtain static tailings images,effectively isolating interference factors at the flotation site.Subsequently,the MRCN,consisting of a multi-scale residual network,is employed to extract image features and compute ash content.Within the MRCN structure,tailings images undergo convolution operations through two parallel branches that utilize convolution kernels of different sizes,enabling the extraction of image features at various scales and capturing a more comprehensive representation of the ash content information.Furthermore,a channel attention mechanism is integrated to enhance the performance of the model.The combination of the multi-scale residual structure and the channel attention mechanism within MRCN results in robust capabilities for image feature extraction and ash content detection.Comparative experiments demonstrate that this proposed approach,based on chromatographic filter paper sampling and the multi-scale residual network,exhibits significantly superior performance in the detection of ash content in coal slime flotation tailings.

Specific Emitter Identification for IoT Devices Based on Deep Residual Shrinkage Networks

Specific emitter identification can distin-guish individual transmitters by analyzing received signals and extracting inherent features of hard-ware circuits.Feature extraction is a key part of traditional machine learning-based methods,but manual extrac-tion is generally limited by prior professional knowl-edge.At the same time,it has been noted that the per-formance of most specific emitter identification meth-ods degrades in the low signal-to-noise ratio(SNR)environments.The deep residual shrinkage network(DRSN)is proposed for specific emitter identification,particularly in the low SNRs.The soft threshold can preserve more key features for the improvement of performance,and an identity shortcut can speed up the training process.We collect signals via the receiver to create a dataset in the actual environments.The DRSN is trained to automatically extract features and imple-ment the classification of transmitters.Experimental results show that DRSN obtains the best accuracy un-der different SNRs and has less running time,which demonstrates the effectiveness of DRSN in identify-ing specific emitters.

Bearing Fault Diagnosis Method of Wind Turbine Based on Improved Anti-Noise Residual Shrinkage Network

Aiming at the difficulty of rolling bearing fault diagnosis of wind turbine under noise environment,a new bearing fault identification method based on the Improved Anti-noise Residual Shrinkage Network(IADRSN)is proposed.Firstly,the vibration signals of wind turbine rolling bearings were preprocessed to obtain data samples divided into training and test sets.Then,a bearing fault diagnosis model based on the improved anti-noise residual shrinkage network was established.To improve the ability of fault feature extraction of the model,the convolution layer in the deep residual shrinkage network was replaced with a Dense-Net layer.To further improve the anti-noise ability of the model,the first layer of the model was set as the Drop-block layer.Finally,the labeled data samples were used for training model and the trained model was applied to the test set to output the fault diagnosis results.The results showed that the proposed method could achieve the fault diagnosis of wind turbine bearing more accurately in the high noise environment through comparison and verification.

Disease Recognition of Apple Leaf Using Lightweight Multi-Scale Network with ECANet

To solve the problem of difficulty in identifying apple diseases in the natural environment and the low application rate of deep learning recognition networks,a lightweight ResNet(LW-ResNet)model for apple disease recognition is proposed.Based on the deep residual network(ResNet18),the multi-scale feature extraction layer is constructed by group convolution to realize the compression model and improve the extraction ability of different sizes of lesion features.By improving the identity mapping structure to reduce information loss.By introducing the efficient channel attention module(ECANet)to suppress noise from a complex background.The experimental results show that the average precision,recall and F1-score of the LW-ResNet on the test set are 97.80%,97.92%and 97.85%,respectively.The parameter memory is 2.32 MB,which is 94%less than that of ResNet18.Compared with the classic lightweight networks SqueezeNet and MobileNetV2,LW-ResNet has obvious advantages in recognition performance,speed,parameter memory requirement and time complexity.The proposed model has the advantages of low computational cost,low storage cost,strong real-time performance,high identification accuracy,and strong practicability,which can meet the needs of real-time identification task of apple leaf disease on resource-constrained devices.

A novel residual shrinkage block-based convolutional neural network for improving the recognition of motor imagery EEG signals

Purpose-Recently,the convolutional neural network(ConvNet)has a wide application in the classification of motor imagery EEG signals,However,the low sigalto-noise electroencephalogram(EEG)signals are ollectede under the interference of noises.However,the conventional ConvNet model cannot directly solve this problem.This study aims to discuss the aforementioned issues.Design/methodology/approach-To solve this problem,this paper adopted a novel residual shrinkage block(RSB)to construct the ComvNet model(RSBConvNet).During the feature extraction from EEG simnals,the proposed RSBConvNet prevented the noise component in EEG signals,and improved the classification accuracy of motor imagery.In the construction of RSBConvNet,the author applied the soft thresholding strategy to prevent the non-related.motor imagery features in EEG sigmals.The soft thresholding was inserted into the residual block(RB),and the suitable threshold for the curent EEG signals distribution can be learned by minimizing the loss function.Therefore,during the feature extraction of motor imagery,the proposed RSBConvNet de noised the EEG signals and improved the discriminative of dassifiation features.Findings-Comparative experiments and ablation studies were done on two public benchumark datasets.Compared with conventionalConvNet models,the proposed RSBConvNet model has olbvious improvements in motor imagery classification accuracy and Kappa officient.Ablation studies have also shown the de noised abilities of the RSBConvNet modeL Morbover,different parameters and computational methods of the RSBConvNet model have been tested om the dassificatiton of motor imagery.Originality/value-Based ou the experimental results,the RSBComvNet constructed in this paper has an excellent reogmition accuracy of M-BCI which can be used for further appications for the online MI-BCI.

基于GRU-DRSN的双通道人体活动识别

人体活动识别(human activity recognizition, HAR)在医疗、军工、智能家居等领域有很大的应用空间。传统机器学习方法特征提取难度较大且精度不高。针对上述问题并结合传感器时序特性,提出了一种融合CBAM(convolutional block attention module)注意力机制的GRU-DRSN双通道并行模型,有效避免了传统串行模型因网络深度加深引起梯度爆炸和消失问题。同时并行结构使得两条支路具有相同的优先级,使用深度残差收缩网络(deep residual shrinkage network, DRSN)提取数据的深层空间特征,同时使用门控循环结构(gated recurrent unit, GRU)学习活动样本在时间序列上的特征,同时进行提取样本不同维度的特征,并通过CBAM模块进行特征的权重分配,最后通过Softmax层进行识别,实现了端对端的人体活动识别。使用公开数据集(wireless sensor data mining, WISDM)进行验证,模型平均精度达到了97.6%,与传统机器学习模型和前人所提神经网络模型相比,有更好的识别效果。

基于多残差注意力深度收缩网络的超微光图像增强方法

超微光成像可在极度黑暗的环境中给观察者提供近乎白昼的视觉体验,在许多民用和军事应用中起着至关重要的作用。超微光环境下拍摄的图像和视频通常存在亮度与对比度极低、噪声水平高、场景细节和色彩严重缺失等固有缺陷,近年来,深度学习为超微光成像的研究带来了新的机遇。文中采集并提供了一组实用性更强的超微光训练数据集,提出了一种多残差注意力深度收缩网络(Multi Residual Attention Shrinkage Network),以此实现了一种新的超微光成像方法。通过成功研制的小型化样机证实了该方法的工业量产前景。实现了基于通道注意力和空间注意力的残差内注意力机制,以及基于深度软阈值收缩的外注意力机制,不仅可以有效提取并还原极低照度环境下的图像细节信息,恢复场景真实色彩,而且可以有效去除此类环境下由成像设备感光不足带来的巨量噪声。实测效果显示该方法可对极低照度环境进行有效的增强且实时性高。通过与多种业界最新方法比较,文中方法在主观视觉体验以及客观参数两方面均表现更好。

Data-driven fault diagnosis of control valve with missing data based on modeling and deep residual shrinkage network

A control valve is one of the most widely used machines in hydraulic systems.However,it often works in harsh environments and failure occurs from time to time.An intelligent and robust control valve fault diagnosis is therefore important for operation of the system.In this study,a fault diagnosis based on the mathematical model(MM)imputation and the modified deep residual shrinkage network(MDRSN)is proposed to solve the problem that data-driven models for control valves are susceptible to changing operating conditions and missing data.The multiple fault time-series samples of the control valve at different openings are collected for fault diagnosis to verify the effectiveness of the proposed method.The effects of the proposed method in missing data imputation and fault diagnosis are analyzed.Compared with random and k-nearest neighbor(KNN)imputation,the accuracies of MM-based imputation are improved by 17.87%and 21.18%,in the circumstances of a20.00%data missing rate at valve opening from 10%to 28%.Furthermore,the results show that the proposed MDRSN can maintain high fault diagnosis accuracy with missing data.

基于深度卷积自编码器和多尺度残差收缩网络的滚动轴承寿命状态识别

针对滚动轴承早期故障识别困难、退化性能难以准确评估的问题,提出了基于深度卷积自编码器(DCAE)和多尺度残差收缩网络(MSRSN)的滚动轴承寿命状态识别方法。首先,为获得清晰的故障特征频率及倍频,将原始数据样本转换为包络谱输入深度卷积自编码器中,实现轴承寿命状态特征的自动提取与表达,并基于多维尺度分析(MDS)算法约简寿命状态特征获得低维特征,然后计算低维特征空间内样本间的欧几里得距离(ED),即为轴承性能衰退评估指标;其次,为全面提取轴承性能衰退特征,提出了改进的多尺度残差收缩网络识别模型,并开发了ReLU与DropBlock正则化相结合的新激活策略增强模型的抗噪性;最后,将所提方法及对比方法应用于轴承全寿命实验数据。实验结果表明:笔者提出的性能衰退评估指标能够精准地识别轴承性能退化起始点以及刻画轴承的退化趋势,所提出的改进的多尺度残差收缩网络识别模型在S SNR=-4~6 dB环境中平均识别正确率为91.75%,能够准确识别轴承寿命状态,验证了方法的实用性以及有效性。

滚动轴承细粒度故障诊断研究

针对目前滚动轴承故障诊断主要采用监督式深度学习提取故障特征以及检测故障种类为粗粒度的现状,提出一种基于高斯混合模型(Gaussian mixed models,GMM)和深度残差收缩网络(deep residual shrinkage networks,DRSN)的滚动轴承细粒度故障诊断方法。GMM模型集成多个高斯分布函数,拟合细粒度故障数据的分布情况,实现对没有标签的轴承振动信号进行聚类,DRSN模型中注意力机制从大量故障特征信息中聚焦于对当前任务更为关键的信息,软阈值化旨在为处于不同健康状态的轴承样本设置不同的阈值。在凯斯西储大学(Case Western Reserve University,CWRU)滚动轴承故障数据中收集30种轴承健康状态对该方法进行了验证,结果表明,将非监督模型与深度学习模型融合,能够处理不含标签情况下的轴承故障数据,实现对轴承故障进行细粒度分类的目的,为后续的设备维护提供依据,具有较好的实际工程意义和推广性。

基于ISAM-Drsnet的故障识别模型及其应用

针对滚动轴承故障诊断时网络模型在复杂环境下有效特征提取困难,无法充分挖掘具有周期性的滚动轴承故障数据时序特征的问题,提出了一种基于改进条纹注意力机制与深度残差收缩网络的滚动轴承故障诊断模型(ISAM-Drsnet)。首先,采用递归图(RP)编码方式生成了二维图像,使用ISAM和改进软阈值算法加强了Drsnet;然后,采取重叠采样的方式对数据集进行了增强处理,并将数据输入到ISAM-Drsnet中,实现了对不同故障类型的识别目的;最后,利用凯斯西储大学滚动轴承数据集进行了实验,选取了最佳数据截取长度,研究了改进软阈值、数据集规模、噪声对模型的影响;同时,将该模型与支持向量机(SVM)、反向传播神经网络(BPNN)、卷积神经网络(CNN)等进行了对比分析,并采用混淆矩阵等可视化方法对该模型进行了性能评估。实验结果表明:该模型(方法)的故障诊断性能明显优于SVM、BPNN、CNN等模型,其故障诊断精度可达99.79%,相比原始的Drsnet上升了1.60%;且在数据集规模有限和信号添加噪声的情况下,模型仍具有较高的故障诊断精度。研究结果表明:该轴承故障诊断模型不仅具有优秀的诊断性能,同时还具有较强的鲁棒性。

基于一维残差收缩网络的电能质量复合扰动识别

电网中强噪声的干扰会严重影响电能质量复合扰动识别,为提高电能质量复合扰动识别准确率,提出一种基于一维残差收缩网络的电能质量复合扰动识别方法。该方法能够以原始数据作为输入避免有效特征的丢失,采用子网络自动设置阈值对各个特征通道进行软阈值化,并通过加宽卷积层进一步增强网络抗噪性。仿真实验结果表明:所提方法在强噪声干扰下能快速准确识别电能质量复合扰动。

基于DRSN和优化BiLSTM的轴承剩余寿命预测方法

针对传统轴承寿命预测方法过度依赖先验知识、缺乏自适应性及退化特征难以提取导致的预测误差大的问题,提出一种自适应特征提取的基于深度残差收缩网络(DRSN)和双向长短时记忆网络(BiLSTM)的轴承剩余寿命预测方法。首先,无需任何先验知识利用DRSN对轴承原始信号进行自动特征学习,提取退化特征并构建健康指标;然后,采用麻雀搜索算法优化BiLSTM隐藏层神经元个数和学习率,基于优化的BiLSTM网络建立轴承剩余寿命预测模型;最后,进行对比实验验证:分别对比DRSN、残差网络、均值特征3种方法提取的健康指标的性能和不同的轴承剩余寿命寿命预测模型进行对比实验。实验结果表明DRSN网络提取的健康指标性能最优,同时基于优化后的BiLSTM轴承剩余寿命预测模型的误差最小,基于优化后BiLSTM、BiLSTM和长短时记忆网络(LSTM)的3种轴承剩余寿命预测模型的均方根误差分别为1.41%、2.71%、5.64%,验证了方法的有效性。

基于MRMR-DRSN的电力系统暂态稳定评估

随着电力系统的广泛互联互通和相量测量单元(phasor measurement unit,PMU)的广泛应用,电力系统的安全运行面临着巨大挑战。为实现对电力系统运行状态快速、准确、有效的评估,提出了一种基于最大相关-最小冗余(max-relevance and min-redundancy,MRMR)准则和深度残差收缩网络(deep residual shrinkage network,DRSN)的暂态稳定评估方法。首先,利用MRMR准则进行特征选择,并将筛选后的关键特征和相应的类标签作为DRSN模型的输入和输出进行离线训练。然后,制定模型更新机制以应对电力系统运行工况变化。最后,基于PMU实时数据和训练好的DRSN,可立即提供暂态稳定评估结果。在IEEE 10机39节点系统上进行测试,结果表明,所提方法相较于其他数据驱动方法的综合评估性能更优异,同时还具有较好的抗噪性能和鲁棒性。

一种TCN的改进模型及其在短期光伏功率区间预测的应用

为了提高光伏功率预测的精度,提出了一种基于时序卷积网络(temporal convolutional network,TCN)的新型短期光伏功率区间预测模型。首先,采用深度残差收缩网络(deep residual shrinkage network,DRSN)的软阈值和注意力机制来改进TCN的残差模块以增强其对有用特征提取能力,并削弱冗余特征的不利影响;然后,利用樽海鞘群算法(slap swarm algorithm,SSA)对TCN的卷积层的卷积核大小和TCN层数等超参数进行自动寻优,以克服原TCN感受野不足的问题;接着,采用核密度估计(kernel density estimation,KDE)方法对所建改进TCN短期光伏功率预测模型的点预测结果进行误差分析,获得模型预测输出的区间。最后,通过对比仿真实验得到的结果表明,提出的SSA-DRSN-TCN模型的RMSE平均值为0.27,优于LSTM、GRU、CNN-LSTM和TCN等模型;而且,KDE方法能够在80%、90%和95%的置信度下准确描述光伏功率波动区间,验证了所提模型在提高光伏功率预测性能上的有效性。

基于改进深度残差收缩网络的旋转机械故障诊断

旋转机械振动信号在多层深度学习过程中会出现退化和过拟合现象,同时含噪数据样本也会使模型故障诊断正确率偏低,数据样本不平衡会引起模型训练具有倾向性,针对以上一系列问题,提出了一种基于改进型深度残差收缩网络(DRSN)的旋转机械故障诊断方法。首先,对多故障、长时间序列数据样本进行了矩阵化处理,得到了模型容易接受的多维度灰度图故障样本;针对旋转机械从正常状态到故障状态的机械老化过程,采用了多点随机采样方法,构建了全寿命周期数据样本,用于后续的故障诊断;然后,在卷积神经网络(CNN)的基础上,通过引入残差项、注意力机制和焦点损失函数,构建起了多层深度残差收缩网络,对旋转机械进行了故障诊断(其中,残差项降低了训练过程中样本数据的特征损失,避免了模型的退化和过拟合;注意力机制和软阈值化自动设置噪声阈值,降低了噪声对故障诊断精度的影响;焦点损失函数修正了模型训练的倾向性,提高了模型训练效率和灵敏性);最后,利用滚动轴承数据库样本对模型的性能进行了实例验证。研究结果表明:DRSN模型在训练过程中没有出现明显的退化现象,能够始终保持较高的训练效率和故障诊断精度,有效避免了噪声干扰,在不平衡数据集上修正了模型训练的倾向性。与其他模型相比较,DRSN多层模型的平均故障诊断精度提高约1%~6%。

基于深度宽卷积残差收缩网络的球磨机负荷状态诊断

针对磨矿复杂工况下球磨机负荷状态准确诊断的难题,提出一种基于深度宽卷积残差收缩网络(Deep Wide Residual Shrinkage Networks, DWRSNs)的球磨机负荷状态诊断方法.首先采用宽卷积神经网络提取振动信号短时特征,建立三层深度残差收缩网络,利用软阈值函数进行非线性变换,再基于注意力机制模块自主学习阈值提取面向负荷状态的高级特征,通过全连接层、softmax层实现球磨机负荷状态的准确分类与判别.实测结果证明,本文提出的DWRSNs方法的拟合度、收敛速度及学习能力均优于现有DCNNs、ResNets和DRSNs诊断方法,且提取的振动信号特征具有高代表性,经TSNE可视化后簇内紧密度高、簇间分界明显.本文方法诊断测试集的准确率超过99%,交叉熵损失为0.077 2,相较于现有负荷状态诊断方法具有更高的准确率且诊断耗时更短,可实现球磨机负荷状态的准确判别,为选冶磨矿过程优化控制、提高磨矿效率提供有效、可靠的判据.