End-to-End Auto-Encoder System for Deep Residual Shrinkage Network for AWGN Channels

With the rapid development of deep learning methods, the data-driven approach has shown powerful advantages over the model-driven one. In this paper, we propose an end-to-end autoencoder communication system based on Deep Residual Shrinkage Networks (DRSNs), where neural networks (DNNs) are used to implement the coding, decoding, modulation and demodulation functions of the communication system. Our proposed autoencoder communication system can better reduce the signal noise by adding an “attention mechanism” and “soft thresholding” modules and has better performance at various signal-to-noise ratios (SNR). Also, we have shown through comparative experiments that the system can operate at moderate block lengths and support different throughputs. It has been shown to work efficiently in the AWGN channel. Simulation results show that our model has a higher Bit-Error-Rate (BER) gain and greatly improved decoding performance compared to conventional modulation and classical autoencoder systems at various signal-to-noise ratios.

Specific Emitter Identification for IoT Devices Based on Deep Residual Shrinkage Networks

Specific emitter identification can distin-guish individual transmitters by analyzing received signals and extracting inherent features of hard-ware circuits.Feature extraction is a key part of traditional machine learning-based methods,but manual extrac-tion is generally limited by prior professional knowl-edge.At the same time,it has been noted that the per-formance of most specific emitter identification meth-ods degrades in the low signal-to-noise ratio(SNR)environments.The deep residual shrinkage network(DRSN)is proposed for specific emitter identification,particularly in the low SNRs.The soft threshold can preserve more key features for the improvement of performance,and an identity shortcut can speed up the training process.We collect signals via the receiver to create a dataset in the actual environments.The DRSN is trained to automatically extract features and imple-ment the classification of transmitters.Experimental results show that DRSN obtains the best accuracy un-der different SNRs and has less running time,which demonstrates the effectiveness of DRSN in identify-ing specific emitters.

Data-driven fault diagnosis of control valve with missing data based on modeling and deep residual shrinkage network

A control valve is one of the most widely used machines in hydraulic systems.However,it often works in harsh environments and failure occurs from time to time.An intelligent and robust control valve fault diagnosis is therefore important for operation of the system.In this study,a fault diagnosis based on the mathematical model(MM)imputation and the modified deep residual shrinkage network(MDRSN)is proposed to solve the problem that data-driven models for control valves are susceptible to changing operating conditions and missing data.The multiple fault time-series samples of the control valve at different openings are collected for fault diagnosis to verify the effectiveness of the proposed method.The effects of the proposed method in missing data imputation and fault diagnosis are analyzed.Compared with random and k-nearest neighbor(KNN)imputation,the accuracies of MM-based imputation are improved by 17.87%and 21.18%,in the circumstances of a20.00%data missing rate at valve opening from 10%to 28%.Furthermore,the results show that the proposed MDRSN can maintain high fault diagnosis accuracy with missing data.

基于GRU-DRSN的双通道人体活动识别

人体活动识别(human activity recognizition, HAR)在医疗、军工、智能家居等领域有很大的应用空间。传统机器学习方法特征提取难度较大且精度不高。针对上述问题并结合传感器时序特性,提出了一种融合CBAM(convolutional block attention module)注意力机制的GRU-DRSN双通道并行模型,有效避免了传统串行模型因网络深度加深引起梯度爆炸和消失问题。同时并行结构使得两条支路具有相同的优先级,使用深度残差收缩网络(deep residual shrinkage network, DRSN)提取数据的深层空间特征,同时使用门控循环结构(gated recurrent unit, GRU)学习活动样本在时间序列上的特征,同时进行提取样本不同维度的特征,并通过CBAM模块进行特征的权重分配,最后通过Softmax层进行识别,实现了端对端的人体活动识别。使用公开数据集(wireless sensor data mining, WISDM)进行验证,模型平均精度达到了97.6%,与传统机器学习模型和前人所提神经网络模型相比,有更好的识别效果。

A novel residual shrinkage block-based convolutional neural network for improving the recognition of motor imagery EEG signals

Purpose-Recently,the convolutional neural network(ConvNet)has a wide application in the classification of motor imagery EEG signals,However,the low sigalto-noise electroencephalogram(EEG)signals are ollectede under the interference of noises.However,the conventional ConvNet model cannot directly solve this problem.This study aims to discuss the aforementioned issues.Design/methodology/approach-To solve this problem,this paper adopted a novel residual shrinkage block(RSB)to construct the ComvNet model(RSBConvNet).During the feature extraction from EEG simnals,the proposed RSBConvNet prevented the noise component in EEG signals,and improved the classification accuracy of motor imagery.In the construction of RSBConvNet,the author applied the soft thresholding strategy to prevent the non-related.motor imagery features in EEG sigmals.The soft thresholding was inserted into the residual block(RB),and the suitable threshold for the curent EEG signals distribution can be learned by minimizing the loss function.Therefore,during the feature extraction of motor imagery,the proposed RSBConvNet de noised the EEG signals and improved the discriminative of dassifiation features.Findings-Comparative experiments and ablation studies were done on two public benchumark datasets.Compared with conventionalConvNet models,the proposed RSBConvNet model has olbvious improvements in motor imagery classification accuracy and Kappa officient.Ablation studies have also shown the de noised abilities of the RSBConvNet modeL Morbover,different parameters and computational methods of the RSBConvNet model have been tested om the dassificatiton of motor imagery.Originality/value-Based ou the experimental results,the RSBComvNet constructed in this paper has an excellent reogmition accuracy of M-BCI which can be used for further appications for the online MI-BCI.