ResNet-UAN-AUD:基于深度学习的水声上行非正交多址通信系统活动用户检测方法

水下声学网络(Underwater Acoustic Networks,UAN)是探测未知水域的重要技术手段。非正交多址(Non-Orthogonal Multiple Access,NOMA)是一种新颖的移动通信技术,支持时域、频域、空域/编域的非正交分配,可有效地提高网络容量和用户接入数,为性能和电量受限的UAN提供创新解决方案。活动用户检测(Active User Detection,AUD)是NOMA通信系统的基础支撑,对于NOMA系统消除信号干扰和提高接收性能至关重要。ResNet是基于残差模块跳跃连接的神经网络,解决了深度学习的梯度消失和网络退化问题。提出了一种基于深度学习的水声上行NOMA通信系统AUD检测方案。首先,构建水声上行NOMA通信系统基本模型;其次,实施NOMA活动用户检测问题的数学表征;接着,开发基于ResNet网络的水声NOMA系统活动节点检测方法(ResNet-UAN-AUD);最后,执行仿真实验。结果表明,ResNet-UAN-AUD的检测性能接近基于长短期记忆网络的活动用户检测(LSTM-UAN-AUD)方案,而复杂度略高于基于卷积神经网络的活动用户检测(CNN-UAN-AUD)技术,实现了次优目标,适合水声上行NOMA系统使用。

基于ResNet-LSTM的航空发动机性能异常检测方法

为了实现数据驱动的航空发动机性能异常的智能检测,提出了一种基于残差网络(ResNet)-长短期记忆网络(LSTM)的发动机性能异常检测方法。采用发动机性能数据图像化方法,在数据降维的同时,完备保留数据的关联特征和时序特征;以残差单元构建发动机性能异常检测模型,在加深网络结构的同时,消除深层网络梯度消失问题,提高发动机性能图像空间关联特征的提取能力。同时,引入LSTM,提出基于ResNet-LSTM的发动机性能异常检测模型,通过ResNet与LSTM的融合,强化异常检测模型对时序特征的提取,提升发动机性能异常检测的准确率;通过发动机运行数据进行验证。结果表明:在训练集上,该方法的异常检测准确率为94.95%,比基于ResNet18、ResNet34、ResNet50异常检测模型的分别提高10.87%、8.00%、3.23%;在测试集上,该方法的异常检测准确率为92.15%,比基于ResNet18、ResNet34、ResNet50异常检测模型的分别提高11.81%、9.45%、3.78%。

基于ResNet的害虫图像质量评估方法

提出一种基于ResNet的害虫图像质量评估方法,从而对林业害虫图像进行预评估。该方法首先提取害虫图像特征,并通过Wasserstein距离计算不同图像特征间的相似分布距离作为质量伪标签进行训练。通过预评估区分出不同质量的林业害虫图像,对其进行筛选、识别、分类,从而达到提高识别准确率的效果。实验结果表明,经过该方法筛选后的林业害虫数据集在ResNet18和ResNet50网络上识别准确率分别提升2.97%,2.57%。

基于信号图像化和CNN-ResNet的配电网单相接地故障选线方法

配电网发生单相接地故障时,零序电流呈现较强的非线性与非平稳性,故障选线较为困难,针对此问题,提出一种基于信号图像化和卷积神经网络-残差网络的配电网单相接地故障选线方法。首先,利用排列熵优化变分模态分解算法的参数,将零序电流信号分解成一系列固有模态函数;其次,引入新的数据预处理方式,将固有模态函数转成二维图像,获得零序电流信号的时频特征图;最后,利用一维卷积神经网络提取零序电流信号的相关性和特征,利用残差网络提取时频特征图的特征,将两个网络融合,构建混合卷积神经网络结构,实现故障选线。仿真与实验结果表明,该方法能够在高阻接地、采样时间不同步、强噪声等情况下准确地选择出故障线路,可满足配电网对故障选线准确性和可靠性的需求。

基于CNN-BiGRU-ResNet的网络入侵检测研究

网络入侵检测是网络安全中的一项重要工作,其主要是通过网络、系统等信息对入侵行为进行判断,它可以及时地发现网络中的攻击行为,传统的网络入侵检测方法存在准确率低并且误报率高的问题,针对上述问题,提出了一种融合双向门控循环单元(BiGRU)、卷积神经网络(CNN)以及残差网络(ResNet)的网络入侵检测方法,该方法通过双向门控循环单元对时间序列特征以及卷积神经网络和残差网络对局部空间特征的提取,利用softmax分类器获得最终的分类结果。实验表明,与基于GRU和ResNet等方法相比,该方法的网络入侵检测效果比较好,其准确率较高,误报率更低。

基于STFT-ECA-ResNet18网络模型的滚动轴承变负载故障诊断

针对传统方法处理变负载轴承故障诊断时存在的自适应能力弱,模型泛化性差的问题,提出了一种改进的基于深度残差网络的故障诊断方法。首先,将采集到的一维时间序列信号进行短时傅里叶变换得到二维时频数据,再利用二维卷积神经网络从变换后的数据中提取特征。然后,通过高效通道注意力机制获取通道全局信息并对其权值进行调整,以增强改进网络模型的泛化能力,使其在变负载工况下分类效果得到提高。最后,通过仿真对所提方法进行了验证,结果表明相比传统方法诊断效果改进明显。

Deep Capsule Residual Networks for Better Diagnosis Rate in Medical Noisy Images

With the advent of Machine and Deep Learning algorithms,medical image diagnosis has a new perception of diagnosis and clinical treatment.Regret-tably,medical images are more susceptible to capturing noises despite the peak in intelligent imaging techniques.However,the presence of noise images degrades both the diagnosis and clinical treatment processes.The existing intelligent meth-ods suffer from the deficiency in handling the diverse range of noise in the ver-satile medical images.This paper proposes a novel deep learning network which learns from the substantial extent of noise in medical data samples to alle-viate this challenge.The proposed deep learning architecture exploits the advan-tages of the capsule network,which is used to extract correlation features and combine them with redefined residual features.Additionally,thefinal stage of dense learning is replaced with powerful extreme learning machines to achieve a better diagnosis rate,even for noisy and complex images.Extensive experimen-tation has been conducted using different medical images.Various performances such as Peak-Signal-To-Noise Ratio(PSNR)and Structural-Similarity-Index-Metrics(SSIM)are compared with the existing deep learning architectures.Addi-tionally,a comprehensive analysis of individual algorithms is analyzed.The experimental results prove that the proposed model has outperformed the other existing algorithms by a substantial margin and proved its supremacy over the other learning models.

Deep Capsule Residual Networks for Better Diagnosis Rate in Medical Noisy Images

With the advent of Machine and Deep Learning algorithms,medical image diagnosis has a new perception of diagnosis and clinical treatment.Regret-tably,medical images are more susceptible to capturing noises despite the peak in intelligent imaging techniques.However,the presence of noise images degrades both the diagnosis and clinical treatment processes.The existing intelligent meth-ods suffer from the deficiency in handling the diverse range of noise in the ver-satile medical images.This paper proposes a novel deep learning network which learns from the substantial extent of noise in medical data samples to alle-viate this challenge.The proposed deep learning architecture exploits the advan-tages of the capsule network,which is used to extract correlation features and combine them with redefined residual features.Additionally,the final stage of dense learning is replaced with powerful extreme learning machines to achieve a better diagnosis rate,even for noisy and complex images.Extensive experimen-tation has been conducted using different medical images.Various performances such as Peak-Signal-To-Noise Ratio(PSNR)and Structural-Similarity-Index-Metrics(SSIM)are compared with the existing deep learning architectures.Addi-tionally,a comprehensive analysis of individual algorithms is analyzed.The experimental results prove that the proposed model has outperformed the other existing algorithms by a substantial margin and proved its supremacy over the other learning models.

多导联心电图识别的稳定步长ResNet深度网络

针对经典的ResNet深度神经网络对一维多导联心电图图像进行识别、分类时,因原始图像的维度较高导致提取到的深度特征维度高,造成全连接层训练出现收敛速度慢和过拟合的问题,在ResNet的全连接层提出一种稳定步长动量训练算法,通过引入近似二阶梯度信息增强动量法的寻优能力和加速收敛速度;利用连续2次迭代的参数变化量和梯度信息自适应调整步长,构造边界函数对步长的大小进行限制,以防止步长过大或过小而影响收敛稳定性,使用动量项对参数的更新方向进行修正。在CPSC2018心电图数据集上的实验结果表明:所提算法训练的ResNet取得的F 1分数、准确率、精确度分别达到0.859、97.4%、87.9%,收敛速度和整体分类指标值优于其他相比较的方法。

拉曼光谱结合WGANGP-ResNet算法鉴别病原菌种类

快速准确识别病原菌在防止传染病的传播、帮助对抗抗菌素耐药性和改善病人预后方面起着关键作用。拉曼光谱结合机器学习算法能够简单快捷地对病原菌进行无标记检测。然而,病原菌种类和表型繁多,并且深度学习需要依赖大量样本训练,而收集大批量病原菌拉曼光谱劳神费力,且易受荧光等因素影响。针对上述问题,提出一种基于WGAN-GP数据增强方法和ResNet结合的病原菌拉曼光谱检测模型。采用五种常见眼科病原菌的拉曼光谱。将采集到的原始数据归一化作为ResNet和传统卷积神经网络(1D-CNN)的输入,将经过SG滤波、airPLS基线校正、PCA降维等预处理后的数据作为K近邻(KNN)的输入,对比分析发现ResNet模型效果最优,其分类精度可达96%;搭建Wasserstein生成式对抗网络加梯度惩罚模型(WGAN-GP),生成大量与真实数据相似的高分辨率光谱数据。同时与偏移法、深度卷积生成式对抗神经网络(DCGAN)2种数据增强方法进行比对,证明WGAN-GP的可靠性;为验证生成数据可以丰富数据多样性,进而提高分类精度,将扩充后的数据集重新放入ResNet进行训练,最终WGAN-GP结合ResNet的分类准确率提高到99.3%。结果表明:基于ResNet的分类模型无需复杂数据预处理,在开发效率和分类精度上均有提高;改进的WGAN-GP模型适用于拉曼光谱数据增强,解决了传统数据增强方法生成光谱的有效性与类别准确性不匹配的问题,相比于GAN提高了训练过程的速度和稳定性;利用表面增强拉曼光谱技术(SERS)结合WGANGP-ResNet模型对病原菌拉曼光谱分类,减少了对大量训练数据的需求,有利于快速学习和分析低信噪比的拉曼光谱,并将光谱采集时间缩减到1/10。在临床快速、免培养鉴别病原菌方面具有重要研究意义与应用价值。

基于改进ResNet网络和迁移学习的服装图像风格识别研究

传统的服装图像风格识别方法主要依赖于成功提取有效特征,这些方法在处理图像时不仅会消耗大量的时间和精力,识别精度也较低。为了提高服装图像风格识别的性能,提出了一种基于改进的ResNet152网络和迁移学习的服装图像风格识别方法。首先将ResNet152网络首层结构中的7×7卷积核替换成3个3×3卷积核组合层,其次把原始残差单元中的“卷积层(Conv)+批归一化层(BN)+非线性激活函数层(Relu)”的组合方式换成“批归一化层(BN)+非线性激活函数层(Relu)+卷积层(Conv)”的组合方式。这两个改进方法有效地提升了网络性能,使其能够更好地捕捉不同尺度的服装风格特征。然后把在ImageNet数据集上训练好的ResNet152网络模型参数迁移到改进的网络中,在此基础上,将女童服装数据集输入到网络中进行训练验证以及微调网络参数。结果表明,所提出的方法风格识别准确率达到了94.2%,训练效果好,识别精度、收敛速度等均优于其他风格识别网络,可以更好的完成女童服装风格识别任务。

Abnormal Traffic Detection for Internet of Things Based on an Improved Residual Network

Along with the progression of Internet of Things(IoT)technology,network terminals are becoming continuously more intelligent.IoT has been widely applied in various scenarios,including urban infrastructure,transportation,industry,personal life,and other socio-economic fields.The introduction of deep learning has brought new security challenges,like an increment in abnormal traffic,which threatens network security.Insufficient feature extraction leads to less accurate classification results.In abnormal traffic detection,the data of network traffic is high-dimensional and complex.This data not only increases the computational burden of model training but also makes information extraction more difficult.To address these issues,this paper proposes an MD-MRD-ResNeXt model for abnormal network traffic detection.To fully utilize the multi-scale information in network traffic,a Multi-scale Dilated feature extraction(MD)block is introduced.This module can effectively understand and process information at various scales and uses dilated convolution technology to significantly broaden the model’s receptive field.The proposed Max-feature-map Residual with Dual-channel pooling(MRD)block integrates the maximum feature map with the residual block.This module ensures the model focuses on key information,thereby optimizing computational efficiency and reducing unnecessary information redundancy.Experimental results show that compared to the latest methods,the proposed abnormal traffic detection model improves accuracy by about 2%.

基于ResNet50和改进注意力机制的船舶识别模型

海洋船舶的自动识别对缓解海上交通压力起着重要作用。针对当前船舶自动识别率较低的问题,提出一种基于ResNet50(Residual Network50)和改进注意力机制的船舶识别模型。首先,自制船舶数据集并划分为训练集、验证集和测试集,采用模糊、增加噪声等方法得到增强数据集;其次,设计改进注意力模块——高效空间金字塔注意力模块(ESPAM)和船舶种类识别模型ResNet50_ESPAM;最后,将ResNet50_ESPAM与其他常用的神经网络模型对船舶数据集进行训练验证并对比。实验结果表明,ResNet50_ESPAM在验证集最高准确率为95.5%,验证集初始准确率为81.2%,与AlexNet(Alex Krizhevsky Network)、GoogleNet(Google Inception Net)、ResNet34(Residual Network34)、ResNet50和ResNet50_CBAM(ResNet50_Convlutional Block Attention Module)等模型相比,模型验证集最高准确率分别提升了5.1、4.9、2.6、1.6和1.4个百分点,验证集初始准确率分别提升了49.4、44.7、27.7、3.0和2.1个百分点。实验结果表明ResNet50_ESPAM在船舶种类识别方面具有较高的识别精度,验证了改进的注意力模块ESPAM的有效性。

Workout Action Recognition in Video Streams Using an Attention Driven Residual DC-GRU Network

Regular exercise is a crucial aspect of daily life, as it enables individuals to stay physically active, lowers thelikelihood of developing illnesses, and enhances life expectancy. The recognition of workout actions in videostreams holds significant importance in computer vision research, as it aims to enhance exercise adherence, enableinstant recognition, advance fitness tracking technologies, and optimize fitness routines. However, existing actiondatasets often lack diversity and specificity for workout actions, hindering the development of accurate recognitionmodels. To address this gap, the Workout Action Video dataset (WAVd) has been introduced as a significantcontribution. WAVd comprises a diverse collection of labeled workout action videos, meticulously curated toencompass various exercises performed by numerous individuals in different settings. This research proposes aninnovative framework based on the Attention driven Residual Deep Convolutional-Gated Recurrent Unit (ResDCGRU)network for workout action recognition in video streams. Unlike image-based action recognition, videoscontain spatio-temporal information, making the task more complex and challenging. While substantial progresshas been made in this area, challenges persist in detecting subtle and complex actions, handling occlusions,and managing the computational demands of deep learning approaches. The proposed ResDC-GRU Attentionmodel demonstrated exceptional classification performance with 95.81% accuracy in classifying workout actionvideos and also outperformed various state-of-the-art models. The method also yielded 81.6%, 97.2%, 95.6%, and93.2% accuracy on established benchmark datasets, namely HMDB51, Youtube Actions, UCF50, and UCF101,respectively, showcasing its superiority and robustness in action recognition. The findings suggest practicalimplications in real-world scenarios where precise video action recognition is paramount, addressing the persistingchallenges in the field. TheWAVd dataset serves as a catalyst for the development ofmore robust and effective fitnesstracking systems and ultimately promotes healthier lifestyles through improved exercise monitoring and analysis.

Attention-Based Residual Dense Shrinkage Network for ECG Denoising

Electrocardiogram(ECG)signal is one of the noninvasive physiological measurement techniques commonly usedin cardiac diagnosis.However,in real scenarios,the ECGsignal is susceptible to various noise erosion,which affectsthe subsequent pathological analysis.Therefore,the effective removal of the noise from ECG signals has becomea top priority in cardiac diagnostic research.Aiming at the problem of incomplete signal shape retention andlow signal-to-noise ratio(SNR)after denoising,a novel ECG denoising network,named attention-based residualdense shrinkage network(ARDSN),is proposed in this paper.Firstly,the shallow ECG characteristics are extractedby a shallow feature extraction network(SFEN).Then,the residual dense shrinkage attention block(RDSAB)isused for adaptive noise suppression.Finally,feature fusion representation(FFR)is performed on the hierarchicalfeatures extracted by a series of RDSABs to reconstruct the de-noised ECG signal.Experiments on the MIT-BIHarrhythmia database and MIT-BIH noise stress test database indicate that the proposed scheme can effectively resistthe interference of different sources of noise on the ECG signal.

基于ResNet的睡姿识别分析

阐述为使智能床垫具有高准确率的睡姿识别功能,设计一种气压传感器结合空气弹簧床垫的睡姿检测系统。使用空气弹簧气压相对变化率作为用户睡姿数据集,提出一种ResNet18睡姿识别模型。

NFHP-RN:AMethod of Few-Shot Network Attack Detection Based on the Network Flow Holographic Picture-ResNet

Due to the rapid evolution of Advanced Persistent Threats(APTs)attacks,the emergence of new and rare attack samples,and even those never seen before,make it challenging for traditional rule-based detection methods to extract universal rules for effective detection.With the progress in techniques such as transfer learning and meta-learning,few-shot network attack detection has progressed.However,challenges in few-shot network attack detection arise from the inability of time sequence flow features to adapt to the fixed length input requirement of deep learning,difficulties in capturing rich information from original flow in the case of insufficient samples,and the challenge of high-level abstract representation.To address these challenges,a few-shot network attack detection based on NFHP(Network Flow Holographic Picture)-RN(ResNet)is proposed.Specifically,leveraging inherent properties of images such as translation invariance,rotation invariance,scale invariance,and illumination invariance,network attack traffic features and contextual relationships are intuitively represented in NFHP.In addition,an improved RN network model is employed for high-level abstract feature extraction,ensuring that the extracted high-level abstract features maintain the detailed characteristics of the original traffic behavior,regardless of changes in background traffic.Finally,a meta-learning model based on the self-attention mechanism is constructed,achieving the detection of novel APT few-shot network attacks through the empirical generalization of high-level abstract feature representations of known-class network attack behaviors.Experimental results demonstrate that the proposed method can learn high-level abstract features of network attacks across different traffic detail granularities.Comparedwith state-of-the-artmethods,it achieves favorable accuracy,precision,recall,and F1 scores for the identification of unknown-class network attacks through cross-validation onmultiple datasets.

基于改进ResNet模型的交通标志识别算法

本文提出了一种基于改进残差网络ResNet50模型的图像识别方法。通过引入圆形LBP算法,提取图像内部的纹理信息构成纹理图谱;同时在网络中加入通道注意力机制(Efficient Channel Attention,ECA)提高模型性能,使得改进后的算法更适合识别交通标志。该方法在GTSRB和BelgiumTS交通标志数据集上的准确率分别达到99.7%和98.3%,有效提高了智能系统识别交通标志的准确率和驾驶的安全性。

Printed Circuit Board (PCB) Surface Micro Defect Detection Model Based on Residual Network with Novel Attention Mechanism

Printed Circuit Board(PCB)surface tiny defect detection is a difficult task in the integrated circuit industry,especially since the detection of tiny defects on PCB boards with large-size complex circuits has become one of the bottlenecks.To improve the performance of PCB surface tiny defects detection,a PCB tiny defects detection model based on an improved attention residual network(YOLOX-AttResNet)is proposed.First,the unsupervised clustering performance of the K-means algorithm is exploited to optimize the channel weights for subsequent operations by feeding the feature mapping into the SENet(Squeeze and Excitation Network)attention network;then the improved K-means-SENet network is fused with the directly mapped edges of the traditional ResNet network to form an augmented residual network(AttResNet);and finally,the AttResNet module is substituted for the traditional ResNet structure in the backbone feature extraction network of mainstream excellent detection models,thus improving the ability to extract small features from the backbone of the target detection network.The results of ablation experiments on a PCB surface defect dataset show that AttResNet is a reliable and efficient module.In Torify the performance of AttResNet for detecting small defects in large-size complex circuit images,a series of comparison experiments are further performed.The results show that the AttResNet module combines well with the five best existing target detection frameworks(YOLOv3,YOLOX,Faster R-CNN,TDD-Net,Cascade R-CNN),and all the combined new models have improved detection accuracy compared to the original model,which suggests that the AttResNet module proposed in this paper can help the detection model to extract target features.Among them,the YOLOX-AttResNet model proposed in this paper performs the best,with the highest accuracy of 98.45% and the detection speed of 36 FPS(Frames Per Second),which meets the accuracy and real-time requirements for the detection of tiny defects on PCB surfaces.This study can provide some new ideas for other real-time online detection tasks of tiny targets with high-resolution images.

Radar Signal Intra-Pulse Modulation Recognition Based on Deep Residual Network

In view of low recognition rate of complex radar intra-pulse modulation signal type by traditional methods under low signal-to-noise ratio(SNR),the paper proposes an automatic recog-nition method of complex radar intra-pulse modulation signal type based on deep residual network.The basic principle of the recognition method is to obtain the transformation relationship between the time and frequency of complex radar intra-pulse modulation signal through short-time Fourier transform(STFT),and then design an appropriate deep residual network to extract the features of the time-frequency map and complete a variety of complex intra-pulse modulation signal type recognition.In addition,in order to improve the generalization ability of the proposed method,label smoothing and L2 regularization are introduced.The simulation results show that the proposed method has a recognition accuracy of more than 95%for complex radar intra-pulse modulation sig-nal types under low SNR(2 dB).