Deep Learning-Based Stacked Auto-Encoder with Dynamic Differential Annealed Optimization for Skin Lesion Diagnosis

Intelligent diagnosis approaches with shallow architectural models play an essential role in healthcare.Deep Learning(DL)models with unsupervised learning concepts have been proposed because high-quality feature extraction and adequate labelled details significantly influence shallow models.On the other hand,skin lesionbased segregation and disintegration procedures play an essential role in earlier skin cancer detection.However,artefacts,an unclear boundary,poor contrast,and different lesion sizes make detection difficult.To address the issues in skin lesion diagnosis,this study creates the UDLS-DDOA model,an intelligent Unsupervised Deep Learning-based Stacked Auto-encoder(UDLS)optimized by Dynamic Differential Annealed Optimization(DDOA).Pre-processing,segregation,feature removal or separation,and disintegration are part of the proposed skin lesion diagnosis model.Pre-processing of skin lesion images occurs at the initial level for noise removal in the image using the Top hat filter and painting methodology.Following that,a Fuzzy C-Means(FCM)segregation procedure is performed using a Quasi-Oppositional Elephant Herd Optimization(QOEHO)algorithm.Besides,a novel feature extraction technique using the UDLS technique is applied where the parameter tuning takes place using DDOA.In the end,the disintegration procedure would be accomplished using a SoftMax(SM)classifier.The UDLS-DDOA model is tested against the International Skin Imaging Collaboration(ISIC)dataset,and the experimental results are examined using various computational attributes.The simulation results demonstrated that the UDLS-DDOA model outperformed the compared methods significantly.

Fault Diagnosis of Motor in Frequency Domain Signal by Stacked De-noising Auto-encoder

With the rapid development of mechanical equipment,mechanical health monitoring field has entered the era of big data.Deep learning has made a great achievement in the processing of large data of image and speech due to the powerful modeling capabilities,this also brings influence to the mechanical fault diagnosis field.Therefore,according to the characteristics of motor vibration signals(nonstationary and difficult to deal with)and mechanical‘big data’,combined with deep learning,a motor fault diagnosis method based on stacked de-noising auto-encoder is proposed.The frequency domain signals obtained by the Fourier transform are used as input to the network.This method can extract features adaptively and unsupervised,and get rid of the dependence of traditional machine learning methods on human extraction features.A supervised fine tuning of the model is then carried out by backpropagation.The Asynchronous motor in Drivetrain Dynamics Simulator system was taken as the research object,the effectiveness of the proposed method was verified by a large number of data,and research on visualization of network output,the results shown that the SDAE method is more efficient and more intelligent.

Fault Diagnosis for Rolling Bearings with Stacked Denoising Auto-encoder of Information Aggregation

Rolling bearings are important central components in rotating machines, whose fault diagnosis is crucial in condition-based maintenance to reduce the complexity of different kinds of faults. To classify various rolling bearing faults, a prognostic algorithm consisting of four phases was proposed. Since stacked denoising auto-encoder can be filtered, noise of large numbers of mechanical vibration signals was used for deep learning structure to extract the characteristics of the noise. Unsupervised pre-training method, which can greatly simplify the traditional manual extraction approach, was utilized to process the depth of the data automatically. Furthermore, the aggregation layer of stacked denoising auto-encoder(SDA) was proposed to get rid of gradient disappearance in deeper layers of network, mix superficial nodes’ expression with deeper layers, and avoid the insufficient express ability in deeper layers. Principal component analysis(PCA) was adopted to extract different features for classification. According to the experimental data of this method and from the comparison results, the proposed method of rolling bearing fault classification reached 97.02% of correct rate, suggesting a better performance than other algorithms.

Predicting the Antigenic Variant of Human Influenza A(H3N2) Virus with a Stacked Auto-Encoder Model

The influenza virus changes its antigenicity frequently due to rapid mutations, leading to immune escape and failure of vaccination. Rapid determination of the influenza antigenicity could help identify the antigenic variants in time. Here, we built a stacked auto-encoder (SAE) model for predicting the antigenic variant of human influenza A(H3N2) viruses based on the hemagglutinin (HA) protein sequences. The model achieved an accuracy of 0.95 in five-fold cross-validations, better than the logistic regression model did. Further analysis of the model shows that most of the active nodes in the hidden layer reflected the combined contribution of multiple residues to antigenic variation. Besides, some features (residues on HA protein) in the input layer were observed to take part in multiple active nodes, such as residue 189, 145 and 156, which were also reported to mostly determine the antigenic variation of influenza A(H3N2) viruses. Overall,this work is not only useful for rapidly identifying antigenic variants in influenza prevention, but also an interesting attempt in inferring the mechanisms of biological process through analysis of SAE model, which may give some insights into interpretation of the deep learning

融合Transformer和卷积LSTM的轨迹分类网络

为了减少原始轨迹数据的噪声,充分提取轨迹的时空特征,提高基于轨迹数据的交通模式分类精度,提出一种融合堆叠降噪自编码器、Transformer和卷积长短期记忆网络的轨迹分类网络(networks fusing stacked denoising auto-encoder, Transformer and ConvLSTM,SDAETC)。通过堆叠降噪自编码器减少原始轨迹数据中的噪声;利用结合了Transformer的递归图自编码器,提取到更为丰富的时间特征,同时利用特征图自编码器提取空间特征;改进卷积长短期记忆网络,充分提取轨迹中的时空特征,并与提取到的时间特征和空间特征相融合,从而实现交通模式分类。实验结果表明,提出的SDAETC与基线模型相比,在GeoLife和SHL数据集上的准确率分别提升了1.8%和2%。此外,消融实验结果和模型训练时间分析表明,引入堆叠降噪自编码器、Transfomer和ConvLSTM虽然增加了时间消耗,但是对分类精度有积极贡献。

A Feature Learning-Based Model for Analyzing Students’ Performance in Supportive Learning

Supportive learning plays a substantial role in providing a quality edu-cation system.The evaluation of students’performance impacts their deeper insight into the subject knowledge.Specifically,it is essential to maintain the baseline foundation for building a broader understanding of their careers.This research concentrates on establishing the students’knowledge relationship even in reduced samples.Here,Synthetic Minority Oversampling TEchnique(SMOTE)technique is used for pre-processing the missing value in the provided input dataset to enhance the prediction accuracy.When the initial processing is not done substantially,it leads to misleading prediction accuracy.This research concentrates on modelling an efficient classifier model to predict students’perfor-mance.Generally,the online available student dataset comprises a lesser amount of sample,and k-fold cross-validation is performed to balance the dataset.Then,the relationship among the students’performance(features)is measured using the auto-encoder.The stacked Long Short Term Memory(s-LSTM)is used to learn the previous feedback connection.The stacked model handles the provided data and the data sequence for understanding the long-term dependencies.The simula-tion is done in the MATLAB 2020a environment,and the proposed model shows a better trade-off than the existing approaches.Some evaluation metrics like pre-diction accuracy,sensitivity,specificity,AUROC,F1-score and recall are evalu-ated using the proposed model.The performance of the s?LSTM model is compared with existing approaches.The proposed model gives 89% accuracy,83% precision,86%recall,and 87%F-score.The proposed model outperforms the existing systems in terms of the earlier metrics.

Early Detection of Heartbeat from Multimodal Data Using RPA Learning with KDNN-SAE

Heartbeat detection stays central to cardiovascular an electrocardiogram(ECG)is used to help with disease diagnosis and management.Existing Convolutional Neural Network(CNN)-based methods suffer from the less generalization problem thus;the effectiveness and robustness of the traditional heartbeat detector methods cannot be guaranteed.In contrast,this work proposes a heartbeat detector Krill based Deep Neural Network Stacked Auto Encoders(KDNN-SAE)that computes the disease before the exact heart rate by combining features from multiple ECG Signals.Heartbeats are classified independently and multiple signals are fused to estimate life threatening conditions earlier without any error in classification of heart beat.This work contained Training and testing stages,in the preparation part at first the Adaptive Filter Enthalpy-based Empirical Mode Decomposition(EMD)is utilized to eliminate the motion artifact in the signal.At that point,the robotic process automation(RPA)learning part extracts the effective features are extracted,and normalized the value of the feature then estimated utilizing the RPA loss function.At last KDNN-SAE prepared training for the data stored in the dataset.In the subsequent stage,input signal compute motion artifact and RPA Learning the evaluation part determines the detection of Heartbeat.So early diagnosis of heart failures is an essential factor.The results of the experiments show that our proposed method has a high score outcome of 0.9997.Comparable to the CIF,which reaches 0.9990.The CNN and Artificial Neural Network(ANN)had less score 0.95115 and 0.90147.

基于数据均衡的增进式深度自动图像标注

自动图像标注是一个包含众多标签、多样特征的富有挑战性的研究问题,是新一代图像检索与图像理解的关键步骤.针对传统的基于浅层机器学习标注算法标注效率低下、难以处理复杂分类任务的问题,提出了基于栈式自动编码器(stacked auto-encoder,简称SAE)的自动图像标注算法,提升了标注效率和标注效果.主要针对图像标注数据不平衡问题,提出两种解决思路:对于标注模型,提出一种增强训练中低频标签的平衡栈式自动编码器(B-SAE),较好地改善了中低频标签的标注效果.并在该模型的基础上提出一种分组强化训练B-SAE子模型的鲁棒平衡栈式自动编码器算法(RB-SAE),提升了标注的稳定性,从而保证模型本身具有较强的处理不平衡数据的能力;对于标注过程,以未知图像作为出发点,首先构造未知图像的局部均衡数据集,并判定该图像的高低频属性以决定不同的标注过程,局部语义传播算法(SP)标注中低频图像,RB-SAE算法标注高频图像,形成属性判别的标注框架(ADA),保证了标注过程具有较强的应对不平衡数据的能力,从而提升整体图像标注效果.通过在3个公共数据集上进行实验验证,结果表明,该方法在许多指标上相比以往方法均有较大提高.

Prediction Model of Aircraft Icing Based on Deep Neural Network

Icing is an important factor threatening aircraft flight safety.According to the requirements of airworthiness regulations,aircraft icing safety assessment is needed to be carried out based on the ice shapes formed under different icing conditions.Due to the complexity of the icing process,the rapid assessment of ice shape remains an important challenge.In this paper,an efficient prediction model of aircraft icing is established based on the deep belief network(DBN)and the stacked auto-encoder(SAE),which are all deep neural networks.The detailed network structures are designed and then the networks are trained according to the samples obtained by the icing numerical computation.After that the model is applied on the ice shape evaluation of NACA0012 airfoil.The results show that the model can accurately capture the nonlinear behavior of aircraft icing and thus make an excellent ice shape prediction.The model provides an important tool for aircraft icing analysis.

A New Method for Sentiment Analysis Using Contextual Auto-Encoders

Sentiment analysis, a hot research topic, presents new challenges for understanding users＇ opinions and judg-ments expressed online. They aim to classify the subjective texts by assigning them a polarity label. In this paper, weintroduce a novel machine learning framework using auto-encoders network to predict the sentiment polarity label at theword level and the sentence level. Inspired by the dimensionality reduction and the feature extraction capabilities of theauto-encoders, we propose a new model for distributed word vector representation ＂PMI-SA＂ using as input pointwise-mutual-information ＂PMI＂ word vectors. The resulted continuous word vectors are combined to represent a sentence. Anunsupervised sentence embedding method, called Contextual Recursive Auto-Encoders ＂CoRAE＂, is also developed forlearning sentence representation. Indeed, CoRAE follows the basic idea of the recursive auto-encoders to deeply composethe vectors of words constituting the sentence, but without relying on any syntactic parse tree. The CoRAE model consistsin combining recursively each word with its context words （neighbors＇ words： previous and next） by considering the wordorder. A support vector machine classifier with fine-tuning technique is also used to show that our deep compositionalrepresentation model CoRAE improves significantly the accuracy of sentiment analysis task. Experimental results demon-strate that CoRAE remarkably outperforms several competitive baseline methods on two databases, namely, Sanders twittercorpus and Facebook comments corpus. The CoRAE model achieves an efficiency of 83.28% with the Facebook dataset and97.57% with the Sanders dataset.

Fault diagnosis method of track circuit based on KPCA-SAE

At present,ZPW-2000 track circuit fault diagnosis is artificially analyzed and monitored.Its discrimination method not only is low efficient and takes a long period,but also requires highly experienced personnel to analyze the data.Therefore,we introduce kernel principal component analysis and stacked auto-encoder network(KPCA-SAD)into the fault diagnosis of ZPW-2000 track circuit.According to the working principle and fault characteristics of track circuit,a fault diagnosis model of KPCA-SAE network is established.The relevant parameters of key components recorded in the data collected by field staff are used as the fault feature parameters.The KPCA method is used to reduce the dimension and noise of fault document matrix to avoid information redundancy.The SAE network is trained by the processed fault data.The model parameters are optimized overall by using back propagation(BP)algorithm.The KPCA-SAE model is simulated in Matlab platform and is finally proved to be effective and feasible.Compared with the traditional method of artificially analyzing fault data and other intelligent algorithms,the KPCA-SAE based classifier has higher fault identification accuracy.

Deep learning model for estimating the mechanical properties of concrete containing silica fume exposed to high temperatures

In this study,the deep learning models for estimating the mechanical properties of concrete containing silica fume subjected to high temperatures were devised.Silica fume was used at concentrations of 0%,5%,10%,and 20%.Cube specimens(100 mm×100 mm×100 mm)were prepared for testing the compressive strength and ultrasonic pulse velocity.They were cured at 20℃zb2℃ in a standard cure for 7,28,and 90 d.After curing,they were subjected to temperatures of 20℃,200℃,400℃,600℃,and 800℃.Two well-known deep learning approaches,i.e.,stacked autoencoders and long short-term memory(LSTM)networks,were used for forecasting the compressive strength and ultrasonic pulse velocity of concrete containing silica fume subjected to high temperatures.The forecasting experiments were carried out using MATLAB deep learning and neural network tools,respectively.Various statistical measures were used to validate the prediction performances of both the approaches.This study found that the LSTM network achieved better results than the stacked autoencoders.In addition,this study found that deep learning,which has a very good prediction ability with little experimental data,was a convenient method for civil engineering.