小样本下基于原型域增强的Meta-DAE故障诊断

滚动轴承作为一种精密的机械元件,已广泛运用于现代工业机械设备中。在轴承运行时,采用合理的方法诊断轴承的故障具有重大的意义。但在实际复杂多变环境下,采集振动信号不仅面临样本量少的问题,还受到噪声干扰、工况变换等因素的影响,导致故障诊断的准确率低。因此,针对噪声干扰和变工况下的小样本滚动轴承故障诊断问题,该文提出了一种基于原型域增强的元学习去噪模型(Meta-DAE)。首先,构造基于时频图的小样本故障样本集,引入深度卷积生成对抗网络并对数据进行预处理,生成相似分布的伪样本集;然后,将故障样本集输入Meta-DAE模型进行自适应特征提取,Meta-DAE模型采用原型域增强策略,使同类别原型点在嵌入空间中凝聚更紧密;同时,构建了具有降噪性能的编码器,设计了基于原型域增强和去噪的目标函数,通过在小样本下进行模型微调,以提高小样本下模型的噪声鲁棒性和分类准确率。噪声及变工况下小样本故障诊断实验结果表明,相比于其他模型,所提模型在-8dB强噪声干扰下,仅用10个样本微调模型,分类准确率提高了35.78~57.25个百分点,具有较强的噪声鲁棒性。

Robust and Efficient Data Transmission over Noisy Communication Channels Using Stacked and Denoising Autoencoders

We study the effects of quantization and additive white Gaussian noise(AWGN) in transmitting latent representations of images over a noisy communication channel. The latent representations are obtained using autoencoders(AEs). We analyze image reconstruction and classification performance for different channel noise powers, latent vector sizes, and number of quantization bits used for the latent variables as well as AEs’ parameters. The results show that the digital transmission of latent representations using conventional AEs alone is extremely vulnerable to channel noise and quantization effects. We then propose a combination of basic AE and a denoising autoencoder(DAE) to denoise the corrupted latent vectors at the receiver. This approach demonstrates robustness against channel noise and quantization effects and enables a significant improvement in image reconstruction and classification performance particularly in adverse scenarios with high noise powers and significant quantization effects.

Data Cleaning Based on Stacked Denoising Autoencoders and Multi-Sensor Collaborations

Wireless sensor networks are increasingly used in sensitive event monitoring.However,various abnormal data generated by sensors greatly decrease the accuracy of the event detection.Although many methods have been proposed to deal with the abnormal data,they generally detect and/or repair all abnormal data without further differentiate.Actually,besides the abnormal data caused by events,it is well known that sensor nodes prone to generate abnormal data due to factors such as sensor hardware drawbacks and random effects of external sources.Dealing with all abnormal data without differentiate will result in false detection or missed detection of the events.In this paper,we propose a data cleaning approach based on Stacked Denoising Autoencoders(SDAE)and multi-sensor collaborations.We detect all abnormal data by SDAE,then differentiate the abnormal data by multi-sensor collaborations.The abnormal data caused by events are unchanged,while the abnormal data caused by other factors are repaired.Real data based simulations show the efficiency of the proposed approach.

基于DA-VMD联合小波阈值的排种器田间振动信号去噪方法

播种机作业过程中排种器会受到非平稳随机振动,对排种性能产生较大的影响,对振动信号采集和分析具有重要意义,而田间振动信号采集过程中受到诸多噪声干扰,难以从中获取有效的信息。本文提出了一种结合蜻蜓算法(Dragonfly algorithm,DA)、变分模态分解(Variational mode decomposition,VMD)和小波阈值的去噪方法,可通过不断迭代更新蜻蜓个体位置和速度,寻找使得VMD分解效果最优的参数组合。以仿真得到的时域随机路面信号为初始信号,分别采用DA-VMD联合小波阈值、小波阈值去噪、经验模态分解(Empirical mode decomposition,EMD)、VMD和小波联合EMD方法对其进行去噪处理,结果表明本文所提出的去噪方法对非平稳随机振动信号去噪效果更优,去噪后信噪比、均方根和相关系数分别为21.570、0.094和0.833。采集田间播种过程不同地表和作业速度下排种器振动信号,并采用DA-VMD联合小波阈值去噪方法对其进行去噪处理,以平滑度、信号能量比和噪声模为评价指标分析去噪效果,结果表明本文所提出方法去噪后信号更加平滑,信号能量比和噪声模更高,且在不同工况条件下均具有较好的去噪效果。

基于MRSDAE-KPCA结合Bi-LST的滚动轴承剩余使用寿命预测

针对现有滚动轴承剩余使用寿命预测方法在提取数据特征时没有充分考虑数据的内部分布,且在构建健康因子时还需要专家经验进行人工提取等问题,提出一种基于流形正则化堆栈去噪自编码器、核主成分分析并结合双向长短时记忆网络的滚动轴承剩余使用寿命预测方法。首先采用无监督的堆栈去噪自编码器网络对原始振动数据进行深层特征提取,并使用核主成分分析法进一步降维,以提高健康因子的指标稳定性;然后在堆栈去噪自编码器中加入流形正则化,最大程度保留编码器隐藏层内部的数据分布结构,提高模型提取数据特征的有效性。最后使用双向长短时记忆网络预测轴承的剩余使用寿命,并采用AdaMax优化算法对网络模型的超参数进行自适应寻优。分析结果表明,提出的滚动轴承剩余使用寿命预测方法具有更高的精度。

基于SDAE的终端区气象场景模式识别方法

气象条件是影响终端区航空器运行安全及效率的主要因素之一。为提高终端区气象场景模式识别精度,采用基于堆叠降噪自编码(SDAE)的聚类模型,在输入层添加随机噪声、构建3层自编码、逐层贪婪训练,降维后的特征作为聚类的输入,实现气象场景的模式识别。以天津滨海国际机场2022年气象观测数据为例,基于SDAE与欧氏距离、汉明距离、曼哈顿距离等传统相似性距离度量方法,分别使用K-medoids与FCM两种聚类方法进行验证。结果表明:基于SDAE的相似性度量在K-medoids与FCM聚类中均表现最优,与其他相似性度量相比差异率分别达到22.4%,12%,17.7%与24.8%,10.7%,11.8%,且运算时间最短,证明了基于SDAE的度量、聚类效果最优,最终识别出8个气象场景,各场景分类清晰明确。

Improved Denoising Autoencoder for Maritime Image Denoising and Semantic Segmentation of USV

Unmanned surface vehicle(USV)is currently a hot research topic in maritime communication network(MCN),where denoising and semantic segmentation of maritime images taken by USV have been rarely studied.The former has recently researched on autoencoder model used for image denoising,but the existed models are too complicated to be suitable for real-time detection of USV.In this paper,we proposed a lightweight autoencoder combined with inception module for maritime image denoising in different noisy environments and explore the effect of different inception modules on the denoising performance.Furthermore,we completed the semantic segmentation task for maritime images taken by USV utilizing the pretrained U-Net model with tuning,and compared them with original U-Net model based on different backbone.Subsequently,we compared the semantic segmentation of noised and denoised maritime images respectively to explore the effect of image noise on semantic segmentation performance.Case studies are provided to prove the feasibility of our proposed denoising and segmentation method.Finally,a simple integrated communication system combining image denoising and segmentation for USV is shown.

Offline Urdu Nastaleeq Optical Character Recognition Based on Stacked Denoising Autoencoder

Offline Urdu Nastaleeq text recognition has long been a serious problem due to its very cursive nature. In order to get rid of the character segmentation problems, many researchers are shifting focus towards segmentation free ligature based recognition approaches. Majority of the prevalent ligature based recognition systems heavily rely on hand-engineered feature extraction techniques. However, such techniques are more error prone and may often lead to a loss of useful information that might hardly be captured later by any manual features. Most of the prevalent Urdu Nastaleeq test recognition was trained and tested on small sets. This paper proposes the use of stacked denoising autoencoder for automatic feature extraction directly from raw pixel values of ligature images. Such deep learning networks have not been applied for the recognition of Urdu text thus far. Different stacked denoising autoencoders have been trained on 178573 ligatures with 3732 classes from un-degraded(noise free) UPTI(Urdu Printed Text Image) data set. Subsequently, trained networks are validated and tested on degraded versions of UPTI data set. The experimental results demonstrate accuracies in range of 93% to 96% which are better than the existing Urdu OCR systems for such large dataset of ligatures.

Reconstruction of time series with missing value using 2D representation-based denoising autoencoder

Time series analysis is a key technology for medical diagnosis,weather forecasting and financial prediction systems.However,missing data frequently occur during data recording,posing a great challenge to data mining tasks.In this study,we propose a novel time series data representation-based denoising autoencoder(DAE)for the reconstruction of missing values.Two data representation methods,namely,recurrence plot(RP)and Gramian angular field(GAF),are used to transform the raw time series to a 2D matrix for establishing the temporal correlations between different time intervals and extracting the structural patterns from the time series.Then an improved DAE is proposed to reconstruct the missing values from the 2D representation of time series.A comprehensive comparison is conducted amongst the different representations on standard datasets.Results show that the 2D representations have a lower reconstruction error than the raw time series,and the RP representation provides the best outcome.This work provides useful insights into the better reconstruction of missing values in time series analysis to considerably improve the reliability of timevarying system.

Denoising Letter Images from Scanned Invoices Using Stacked Autoencoders

Invoice document digitization is crucial for efficient management in industries.The scanned invoice image is often noisy due to various reasons.This affects the OCR(optical character recognition)detection accuracy.In this paper,letter data obtained from images of invoices are denoised using a modified autoencoder based deep learning method.A stacked denoising autoencoder(SDAE)is implemented with two hidden layers each in encoder network and decoder network.In order to capture the most salient features of training samples,a undercomplete autoencoder is designed with non-linear encoder and decoder function.This autoencoder is regularized for denoising application using a combined loss function which considers both mean square error and binary cross entropy.A dataset consisting of 59,119 letter images,which contains both English alphabets(upper and lower case)and numbers(0 to 9)is prepared from many scanned invoices images and windows true type(.ttf)files,are used for training the neural network.Performance is analyzed in terms of Signal to Noise Ratio(SNR),Peak Signal to Noise Ratio(PSNR),Structural Similarity Index(SSIM)and Universal Image Quality Index(UQI)and compared with other filtering techniques like Nonlocal Means filter,Anisotropic diffusion filter,Gaussian filters and Mean filters.Denoising performance of proposed SDAE is compared with existing SDAE with single loss function in terms of SNR and PSNR values.Results show the superior performance of proposed SDAE method.

A Double-Weighted Deterministic Extreme Learning Machine Based on Sparse Denoising Autoencoder and Its Applications

Extreme learning machine (ELM) is a feedforward neural network-based machine learning method that has the benefits of short training times, strong generalization capabilities, and will not fall into local minima. However, due to the traditional ELM shallow architecture, it requires a large number of hidden nodes when dealing with high-dimensional data sets to ensure its classification performance. The other aspect, it is easy to degrade the classification performance in the face of noise interference from noisy data. To improve the above problem, this paper proposes a double pseudo-inverse extreme learning machine (DPELM) based on Sparse Denoising AutoEncoder (SDAE) namely, SDAE-DPELM. The algorithm can directly determine the input weight and output weight of the network by using the pseudo-inverse method. As a result, the algorithm only requires a few hidden layer nodes to produce superior classification results when classifying data. And its combination with SDAE can effectively improve the classification performance and noise resistance. Extensive numerical experiments show that the algorithm has high classification accuracy and good robustness when dealing with high-dimensional noisy data and high-dimensional noiseless data. Furthermore, applying such an algorithm to Miao character recognition substantiates its excellent performance, which further illustrates the practicability of the algorithm.

融合DAE-LSTM的认知物联网智能频谱感知算法

第五代(fifth-generation,5G)移动通信技术的兴起,推动了物联网(Internet of things,IoT)的发展。然而,随着物联网数据传输量的爆发式增长,频谱资源短缺问题越来越严重。频谱感知技术极大的提高了物联网频谱利用率。但是,物联网移动通信环境的复杂性高以及信号易畸变的特性,对现有的频谱感知算法提出了重大挑战。因此,提出了一种融合去噪自编码器(denoising autoencoder,DAE)和改进长短时记忆(long short term memory,LSTM)神经网络的智能频谱感知算法。DAE通过编码和解码过程挖掘移动信号的底层结构特征,改进的LSTM频谱感知分类器模型结合过去时刻信息特征对时序信号序列进行分类。与支持向量机(support vector machine,SVM)、循环神经网络(recurrent neural network,RNN)、LeNet5、学习矢量量化(learning vector quantization,LVQ)和Elman算法相比,该算法的感知性能提高了45%。

基于DAE和改进RFKM的负荷数据精准特征提取与标签定义

针对目前配电网用户负荷数据高维度时序数据特征提取难、交叉数据聚类处理难、负荷数据精准标签化难等问题,文章提出面向用户负荷数据的基于降噪自编码器和改进粗糙模糊K均值的特征提取与标签定义模型(feature extraction and label definition model based on DAE and improve RFKM,FLMbD-iR)。FLMbD-iR通过降噪自编码器对原始用户负荷数据进行深度特征提取后,利用基于类簇规模不均衡度量的粗糙模糊K均值进行聚类,处理聚类中簇间交叉数据存在误差的缺陷,最后构建描述指标对典型日负荷曲线进行标签定义。实验采用美国电力负荷数据进行仿真模拟,实验结果显示本方法在用户负荷数据聚类处理上效果显著。

改进ADASYN-SDA的入侵检测模型研究

针对传统入侵检测模型在高维数据且数据不均衡环境下检测性能较差的问题,提出了一种自适应过采样算法(ADASYN)与改进堆叠式降噪自编码器(SDA)结合的入侵检测模型。使用ADASYN算法进行数据过采样处理。使用Adam优化算法,以及Dropout正则化对SDA深度学习模型进行改进,提取出低维数、高鲁棒性的集成特征。在softmax分类器中进行入侵检测识别。实验结果表明,ADASYN-SDA模型相较于SDA、AE-DNN和MSVM模型,在平均准确率、检测率和误判率上均有一定程度的提高。

基于多时空尺度特性的风电场物理-数据融合动态等值建模

文中提出了一种风电场动态等值建模方法。核心思路是将风电场对象的物理特征分析与数据分析进行有效融合,构建出反映风电场暂态特性的数据特征,并针对风电暂态波动多变特征提出基于形状的距离的分群聚类算法,从而实现场站内具有相似动态风电机组的分群等值。首先,围绕风电场多时空尺度特征展开物理特性分析,提出反映风电场站动态特性的核心因素集合;其次,针对核心因素多且存在相关性这一问题,采用降噪自编码器算法来对核心因素集合进行降维,去除冗余信息后构建数据特征;然后,引入基于形状的距离度量的聚类算法,实现风电场发电单元分群;最后,以某风电场为例,在PSCAD/EMTDC平台仿真验证了所提方法的有效性。

基于SDAE特征表示的协同主题回归推荐模型

为解决推荐系统中的冷启动问题,在协同主题回归CTR模型的基础上引入堆叠去噪自编码器SDAE深度学习网络,用于学习用户辅助信息的隐表示,建立SDAE-CTR模型。模型应用2层SDAE网络,以用户信息为网络输入量,将编码过程获得的用户辅助信息的隐表示和解码过程获得的输入近似表示为网络的双输出量,最小化用户辅助信息和近似表示的差值来确定最优隐表示。模型融合用户-项目评分矩阵(冷启动条件无评分)、项目内容信息和用户辅助信息实现用户对未评分项目的评分预测,并在LastFM、Book Crossing和MovieLens数据集上从推荐准确度、新颖性和用户冷启动条件下的推荐效果等3方面对SDAE-CTR模型和CTR模型进行比较。结果表明,SDAE-CTR模型在冷启动或非冷启动的条件下,推荐效果都要优于CTR模型的,虽然新颖性较CTR模型稍微逊色一些,但理论上在合理的范围内,总体上SDAE-CTR模型表现较优。

基于DA-SVM的软件缺陷预测模型

特征提取是软件缺陷预测技术研究中的重要环节,而现有的特征提取方法无法准确获得特征之间的非线性依赖关系,因而无法提高软件缺陷预测的准确性。针对该问题,本文构建基于降噪编码器和支持向量机的软件缺陷预测模型(Denoising Autoencoder Support Vector Machine,DA-SVM)。首先利用降噪编码器进行特征提取,然后将提取的特征作为支持向量机的输入向量,最后再进行软件缺陷预测。实验结果表明,DA-SVM提高了软件缺陷预测的准确度,同时降低了历史数据中的噪声,增强了软件预测模型的鲁棒性。

多层DAE协同LSSVM的瓦斯突出预测模型

为准确预测瓦斯突出,提出多层去噪自编码器(Multi-layer DAE)搭载最小二乘支持向量机(LSSVM)的瓦斯突出预测模型。多层DAE网络提取瓦斯突出原始数据的有效特征,并链接LSSVM进行突出分类。因突出影响因子边界存在一定的模糊性,从时间角度考虑将其分为动、静态影响因子,并依此对多层DAE网络按照交叉熵规则设计新的代价函数。利用收集的100组真实样本数据,多次实验确定最稳定的模型结构参数。对比分析PCA-LSSVM、LLE-LSSVM、BP神经网络模型,结果表明,该模型有更优越的特征提取能力和预测性能,更适用与瓦斯突出预测问题。

基于改进LDA和自编码器的调制识别算法

传统调制识别算法是基于高斯白噪声信道的,在复杂信道条件下识别性能明显下降。针对此问题,提出基于抗混淆线性判别分析A-ALDA (Anti-alias Linear Discriminant Analysis)和堆叠稀疏降噪自编码器SSDAE (Stacked Sparse Denoising Autoencoders)的调制识别算法。该算法中,A-ALDA算法将信号累积量特征重构为新的特征,这些特征具有更优的分离性能;将原始特征与新特征输入SSDAE进行分类,SSDAE具有提取关键信息和抗噪声的能力。结果表明,本文算法的识别准确率高于已有的算法;并且在有限信号长度条件下和相位、频率误差干扰情况下,识别准确率均有提高。

锂离子电池健康状态的DCAE-Transformer预测方法研究

提出了一种基于Transformer的DCAE-Transformer模型,旨在改善健康状态(SOH)估计的准确性.该方法通过Pearson相关系数筛选关键特征,利用去噪自编码器(DAE)和卷积神经网络(CNN)相结合进行数据预处理和特征提取,再将数据输入Transformer框架完成预测.使用NASA和CALCE提供的数据集进行验证,DCAE-Transformer模型在NASA电池样本上的误差指标(EMA、EMAP和ERMS)均低于1%,R2值超过99.5%;在CALCE样本上,误差指标低于5%,R2值超过98%.结果表明,该模型在锂电池SOH估计方面具有较高的精确性和泛化性.