A multi-scale convolutional auto-encoder and its application in fault diagnosis of rolling bearings

Aiming at the difficulty of fault identification caused by manual extraction of fault features of rotating machinery,a one-dimensional multi-scale convolutional auto-encoder fault diagnosis model is proposed,based on the standard convolutional auto-encoder.In this model,the parallel convolutional and deconvolutional kernels of different scales are used to extract the features from the input signal and reconstruct the input signal;then the feature map extracted by multi-scale convolutional kernels is used as the input of the classifier;and finally the parameters of the whole model are fine-tuned using labeled data.Experiments on one set of simulation fault data and two sets of rolling bearing fault data are conducted to validate the proposed method.The results show that the model can achieve 99.75%,99.3%and 100%diagnostic accuracy,respectively.In addition,the diagnostic accuracy and reconstruction error of the one-dimensional multi-scale convolutional auto-encoder are compared with traditional machine learning,convolutional neural networks and a traditional convolutional auto-encoder.The final results show that the proposed model has a better recognition effect for rolling bearing fault data.

Fault Diagnosis of Motor in Frequency Domain Signal by Stacked De-noising Auto-encoder

With the rapid development of mechanical equipment,mechanical health monitoring field has entered the era of big data.Deep learning has made a great achievement in the processing of large data of image and speech due to the powerful modeling capabilities,this also brings influence to the mechanical fault diagnosis field.Therefore,according to the characteristics of motor vibration signals(nonstationary and difficult to deal with)and mechanical‘big data’,combined with deep learning,a motor fault diagnosis method based on stacked de-noising auto-encoder is proposed.The frequency domain signals obtained by the Fourier transform are used as input to the network.This method can extract features adaptively and unsupervised,and get rid of the dependence of traditional machine learning methods on human extraction features.A supervised fine tuning of the model is then carried out by backpropagation.The Asynchronous motor in Drivetrain Dynamics Simulator system was taken as the research object,the effectiveness of the proposed method was verified by a large number of data,and research on visualization of network output,the results shown that the SDAE method is more efficient and more intelligent.

Outlier Detection for Water Supply Data Based on Joint Auto-Encoder

With the development of science and technology,the status of the water environment has received more and more attention.In this paper,we propose a deep learning model,named a Joint Auto-Encoder network,to solve the problem of outlier detection in water supply data.The Joint Auto-Encoder network first expands the size of training data and extracts the useful features from the input data,and then reconstructs the input data effectively into an output.The outliers are detected based on the network’s reconstruction errors,with a larger reconstruction error indicating a higher rate to be an outlier.For water supply data,there are mainly two types of outliers:outliers with large values and those with values closed to zero.We set two separate thresholds,and,for the reconstruction errors to detect the two types of outliers respectively.The data samples with reconstruction errors exceeding the thresholds are voted to be outliers.The two thresholds can be calculated by the classification confusion matrix and the receiver operating characteristic(ROC)curve.We have also performed comparisons between the Joint Auto-Encoder and the vanilla Auto-Encoder in this paper on both the synthesis data set and the MNIST data set.As a result,our model has proved to outperform the vanilla Auto-Encoder and some other outlier detection approaches with the recall rate of 98.94 percent in water supply data.

Application of Improved Deep Auto-Encoder Network in Rolling Bearing Fault Diagnosis

Since the effectiveness of extracting fault features is not high under traditional bearing fault diagnosis method, a bearing fault diagnosis method based on Deep Auto-encoder Network (DAEN) optimized by Cloud Adaptive Particle Swarm Optimization (CAPSO) was proposed. On the basis of analyzing CAPSO and DAEN, the CAPSO-DAEN fault diagnosis model is built. The model uses the randomness and stability of CAPSO algorithm to optimize the connection weight of DAEN, to reduce the constraints on the weights and extract fault features adaptively. Finally, efficient and accurate fault diagnosis can be implemented with the Softmax classifier. The results of test show that the proposed method has higher diagnostic accuracy and more stable diagnosis results than those based on the DAEN, Support Vector Machine (SVM) and the Back Propagation algorithm (BP) under appropriate parameters.

颈椎前路Hybrid手术和颈椎后路单开门椎管扩大成形术治疗多节段脊髓型颈椎病临床疗效分析

目的:分析颈椎前路Hybrid手术和颈椎后路单开门椎管扩大成形术(EODL)治疗多节段脊髓型颈椎病的疗效,探讨多节段脊髓型颈椎病患者手术方式的选择。方法:对2017年7月—2020年7月在首都医科大学附属北京中医医院手术治疗的70例多节段脊髓型颈椎病患者进行回顾性分析,根据手术方式不同,分为前路组35例和后路组35例,前路组患者行Hybrid手术[颈椎前路椎间盘切除融合术(ACDF)联合人工颈椎间盘置换术(ACDR)],后路组患者行EODL。记录2组患者住院时间、手术时间、术中出血量和术后引流量,通过日本骨科协会(JOA)评分、JOA改善率、颈椎残障功能指数(NDI)、疼痛视觉模拟评分(VAS)和术后满意度评分进行疗效评价,统计2组患者术后并发症发生情况。结果:与后路组比较,前路组患者术中出血量、术后引流量、住院时间和手术时间均明显减少(P<0.01),术前各项评分差异无统计学意义(P>0.05)。末次随访时,与后路组比较,前路组患者JOA评分和JOA改善率明显升高(P<0.01),NDI评分和VAS评分明显降低(P<0.01)。与术前比较,末次随访时2组患者JOA评分明显升高(P<0.01),NDI和VAS评分均明显降低(P<0.01)。按术后满意度评分评价,2组患者术后满意度均较高。2组患者术后并发症发生率比较差异无统计学意义(P>0.05)。结论:颈椎前路Hybrid手术和EODL在治疗多节段脊髓型颈椎病方面均取得了较为满意的疗效。Hybrid手术具有出血量少和手术时间短等优点,临床上应根据患者实际情况选择最适宜的术式。

An Efficient Encryption and Compression of Sensed IoT Medical Images Using Auto-Encoder

Healthcare systems nowadays depend on IoT sensors for sending data over the internet as a common practice.Encryption ofmedical images is very important to secure patient information.Encrypting these images consumes a lot of time onedge computing;therefore,theuse of anauto-encoder for compressionbefore encodingwill solve such a problem.In this paper,we use an auto-encoder to compress amedical image before encryption,and an encryption output(vector)is sent out over the network.On the other hand,a decoder was used to reproduce the original image back after the vector was received and decrypted.Two convolutional neural networks were conducted to evaluate our proposed approach:The first one is the auto-encoder,which is utilized to compress and encrypt the images,and the other assesses the classification accuracy of the image after decryption and decoding.Different hyperparameters of the encoder were tested,followed by the classification of the image to verify that no critical information was lost,to test the encryption and encoding resolution.In this approach,sixteen hyperparameter permutations are utilized,but this research discusses three main cases in detail.The first case shows that the combination of Mean Square Logarithmic Error(MSLE),ADAgrad,two layers for the auto-encoder,and ReLU had the best auto-encoder results with a Mean Absolute Error(MAE)=0.221 after 50 epochs and 75%classification with the best result for the classification algorithm.The second case shows the reflection of auto-encoder results on the classification results which is a combination ofMean Square Error(MSE),RMSprop,three layers for the auto-encoder,and ReLU,which had the best classification accuracy of 65%,the auto-encoder gives MAE=0.31 after 50 epochs.The third case is the worst,which is the combination of the hinge,RMSprop,three layers for the auto-encoder,and ReLU,providing accuracy of 20%and MAE=0.485.

Fault Diagnosis for Rolling Bearings with Stacked Denoising Auto-encoder of Information Aggregation

Rolling bearings are important central components in rotating machines, whose fault diagnosis is crucial in condition-based maintenance to reduce the complexity of different kinds of faults. To classify various rolling bearing faults, a prognostic algorithm consisting of four phases was proposed. Since stacked denoising auto-encoder can be filtered, noise of large numbers of mechanical vibration signals was used for deep learning structure to extract the characteristics of the noise. Unsupervised pre-training method, which can greatly simplify the traditional manual extraction approach, was utilized to process the depth of the data automatically. Furthermore, the aggregation layer of stacked denoising auto-encoder(SDA) was proposed to get rid of gradient disappearance in deeper layers of network, mix superficial nodes’ expression with deeper layers, and avoid the insufficient express ability in deeper layers. Principal component analysis(PCA) was adopted to extract different features for classification. According to the experimental data of this method and from the comparison results, the proposed method of rolling bearing fault classification reached 97.02% of correct rate, suggesting a better performance than other algorithms.

Transfer learning with deep sparse auto-encoder for speech emotion recognition

In order to improve the efficiency of speech emotion recognition across corpora,a speech emotion transfer learning method based on the deep sparse auto-encoder is proposed.The algorithm first reconstructs a small amount of data in the target domain by training the deep sparse auto-encoder,so that the encoder can learn the low-dimensional structural representation of the target domain data.Then,the source domain data and the target domain data are coded by the trained deep sparse auto-encoder to obtain the reconstruction data of the low-dimensional structural representation close to the target domain.Finally,a part of the reconstructed tagged target domain data is mixed with the reconstructed source domain data to jointly train the classifier.This part of the target domain data is used to guide the source domain data.Experiments on the CASIA,SoutheastLab corpus show that the model recognition rate after a small amount of data transferred reached 89.2%and 72.4%on the DNN.Compared to the training results of the complete original corpus,it only decreased by 2%in the CASIA corpus,and only 3.4%in the SoutheastLab corpus.Experiments show that the algorithm can achieve the effect of labeling all data in the extreme case that the data set has only a small amount of data tagged.

Deep Learning-Based Stacked Auto-Encoder with Dynamic Differential Annealed Optimization for Skin Lesion Diagnosis

Intelligent diagnosis approaches with shallow architectural models play an essential role in healthcare.Deep Learning(DL)models with unsupervised learning concepts have been proposed because high-quality feature extraction and adequate labelled details significantly influence shallow models.On the other hand,skin lesionbased segregation and disintegration procedures play an essential role in earlier skin cancer detection.However,artefacts,an unclear boundary,poor contrast,and different lesion sizes make detection difficult.To address the issues in skin lesion diagnosis,this study creates the UDLS-DDOA model,an intelligent Unsupervised Deep Learning-based Stacked Auto-encoder(UDLS)optimized by Dynamic Differential Annealed Optimization(DDOA).Pre-processing,segregation,feature removal or separation,and disintegration are part of the proposed skin lesion diagnosis model.Pre-processing of skin lesion images occurs at the initial level for noise removal in the image using the Top hat filter and painting methodology.Following that,a Fuzzy C-Means(FCM)segregation procedure is performed using a Quasi-Oppositional Elephant Herd Optimization(QOEHO)algorithm.Besides,a novel feature extraction technique using the UDLS technique is applied where the parameter tuning takes place using DDOA.In the end,the disintegration procedure would be accomplished using a SoftMax(SM)classifier.The UDLS-DDOA model is tested against the International Skin Imaging Collaboration(ISIC)dataset,and the experimental results are examined using various computational attributes.The simulation results demonstrated that the UDLS-DDOA model outperformed the compared methods significantly.

Activation Redistribution Based Hybrid Asymmetric Quantization Method of Neural Networks

The demand for adopting neural networks in resource-constrained embedded devices is continuously increasing.Quantization is one of the most promising solutions to reduce computational cost and memory storage on embedded devices.In order to reduce the complexity and overhead of deploying neural networks on Integeronly hardware,most current quantization methods use a symmetric quantization mapping strategy to quantize a floating-point neural network into an integer network.However,although symmetric quantization has the advantage of easier implementation,it is sub-optimal for cases where the range could be skewed and not symmetric.This often comes at the cost of lower accuracy.This paper proposed an activation redistribution-based hybrid asymmetric quantizationmethod for neural networks.The proposedmethod takes data distribution into consideration and can resolve the contradiction between the quantization accuracy and the ease of implementation,balance the trade-off between clipping range and quantization resolution,and thus improve the accuracy of the quantized neural network.The experimental results indicate that the accuracy of the proposed method is 2.02%and 5.52%higher than the traditional symmetric quantization method for classification and detection tasks,respectively.The proposed method paves the way for computationally intensive neural network models to be deployed on devices with limited computing resources.Codes will be available on https://github.com/ycjcy/Hybrid-Asymmetric-Quantization.

基于Hybrid A^(*)算法的变压器声级巡检系统研究与设计

随着国内变电站数目逐步增加,采用固定式声级监测终端对变压器声级检测的方式已经满足不了日常检测的需求。为解决固定式声级监测终端方式成本高、维护复杂、设备利用率低等问题,该文率先提出了一种变压器声级巡检系统,并设计了最优声级巡检路径。通过场地定位传感器生成变压器场地栅格图信息,采用Hybrid A^(*)算法将场地栅格图信息生成符合国标所要求的最优声级巡检路径检测点;针对所开发的变压器声级巡检装置,采用生成的巡检路径对变压器进行声级测定作业,对测定的声级数据进行分析处理。测试结果表明,该文开发的系统与设计算法的变压器声级巡检时间、检测效率以及数据的采集准确性都优于固定式声级监测终端方式,系统完成变压器声级巡检全过程的成功率可达95%。

复杂建设环境下基于Hybrid A^(*)算法的铁路平面线形绿色优化设计

随着“双碳经济下绿色铁路”理念的兴起,将“绿色生态”融入到铁路平面线路优化已成为近年来的研究热点。本文以铁路建设成本与生态破坏成本的协同优化为目标,引入并改进了一种自动驾驶导航算法(Hybrid A^(*)算法),以适应复杂的铁路设计问题,同时考虑最小曲线半径、最大曲线半径、最短曲线长度、最短夹直线长度、缓和曲线长度等铁路线形约束。研究结果表明:(1)改进后算法以离散网格方式整合外部环境因素,实现渐进式全局探索,获取接近全局最优的铁路线路设计结果;(2)该方法在复杂外部环境约束下,无需预设水平交点位置和数量,可自动生成符合线路-环境耦合约束的优化平面线路方案。

Hybrid model for BOF oxygen blowing time prediction based on oxygen balance mechanism and deep neural network

The amount of oxygen blown into the converter is one of the key parameters for the control of the converter blowing process,which directly affects the tap-to-tap time of converter. In this study, a hybrid model based on oxygen balance mechanism (OBM) and deep neural network (DNN) was established for predicting oxygen blowing time in converter. A three-step method was utilized in the hybrid model. First, the oxygen consumption volume was predicted by the OBM model and DNN model, respectively. Second, a more accurate oxygen consumption volume was obtained by integrating the OBM model and DNN model. Finally, the converter oxygen blowing time was calculated according to the oxygen consumption volume and the oxygen supply intensity of each heat. The proposed hybrid model was verified using the actual data collected from an integrated steel plant in China, and compared with multiple linear regression model, OBM model, and neural network model including extreme learning machine, back propagation neural network, and DNN. The test results indicate that the hybrid model with a network structure of 3 hidden layer layers, 32-16-8 neurons per hidden layer, and 0.1 learning rate has the best prediction accuracy and stronger generalization ability compared with other models. The predicted hit ratio of oxygen consumption volume within the error±300 m^(3)is 96.67%;determination coefficient (R^(2)) and root mean square error (RMSE) are0.6984 and 150.03 m^(3), respectively. The oxygen blow time prediction hit ratio within the error±0.6 min is 89.50%;R2and RMSE are0.9486 and 0.3592 min, respectively. As a result, the proposed model can effectively predict the oxygen consumption volume and oxygen blowing time in the converter.

Regulatable Orthotropic 3D Hybrid Continuous Carbon Networks for Efficient Bi-Directional Thermal Conduction

Vertically oriented carbon structures constructed from low-dimen-sional carbon materials are ideal frameworks for high-performance thermal inter-face materials(TIMs).However,improving the interfacial heat-transfer efficiency of vertically oriented carbon structures is a challenging task.Herein,an orthotropic three-dimensional(3D)hybrid carbon network(VSCG)is fabricated by depositing vertically aligned carbon nanotubes(VACNTs)on the surface of a horizontally oriented graphene film(HOGF).The interfacial interaction between the VACNTs and HOGF is then optimized through an annealing strategy.After regulating the orientation structure of the VACNTs and filling the VSCG with polydimethylsi-loxane(PDMS),VSCG/PDMS composites with excellent 3D thermal conductive properties are obtained.The highest in-plane and through-plane thermal conduc-tivities of the composites are 113.61 and 24.37 W m^(-1)K^(-1),respectively.The high contact area of HOGF and good compressibility of VACNTs imbue the VSCG/PDMS composite with low thermal resistance.In addition,the interfacial heat-transfer efficiency of VSCG/PDMS composite in the TIM performance was improved by 71.3%compared to that of a state-of-the-art thermal pad.This new structural design can potentially realize high-performance TIMs that meet the need for high thermal conductivity and low contact thermal resistance in interfacial heat-transfer processes.

SNP site-drug association prediction algorithm based on denoising variational auto-encoder

Single nucletide polymorphism(SNP)is an important factor for the study of genetic variation in human families and animal and plant strains.Therefore,it is widely used in the study of population genetics and disease related gene.In pharmacogenomics research,identifying the association between SNP site and drug is the key to clinical precision medication,therefore,a predictive model of SNP site and drug association based on denoising variational auto-encoder(DVAE-SVM)is proposed.Firstly,k-mer algorithm is used to construct the initial SNP site feature vector,meanwhile,MACCS molecular fingerprint is introduced to generate the feature vector of the drug module.Then,we use the DVAE to extract the effective features of the initial feature vector of the SNP site.Finally,the effective feature vector of the SNP site and the feature vector of the drug module are fused input to the support vector machines(SVM)to predict the relationship of SNP site and drug module.The results of five-fold cross-validation experiments indicate that the proposed algorithm performs better than random forest(RF)and logistic regression(LR)classification.Further experiments show that compared with the feature extraction algorithms of principal component analysis(PCA),denoising auto-encoder(DAE)and variational auto-encode(VAE),the proposed algorithm has better prediction results.

p-d Orbital Hybridization Engineered Single-Atom Catalyst for Electrocatalytic Ammonia Synthesis

The rational design of metal single-atom catalysts(SACs)for electrochemical nitrogen reduction reaction(NRR)is challenging.Two-dimensional metal-organic frameworks(2DMOFs)is a unique class of promising SACs.Up to now,the roles of individual metals,coordination atoms,and their synergy effect on the electroanalytic performance remain unclear.Therefore,in this work,a series of 2DMOFs with different metals and coordinating atoms are systematically investigated as electrocatalysts for ammonia synthesis using density functional theory calculations.For a specific metal,a proper metal-intermediate atoms p-d orbital hybridization interaction strength is found to be a key indicator for their NRR catalytic activities.The hybridization interaction strength can be quantitatively described with the p-/d-band center energy difference(Δd-p),which is found to be a sufficient descriptor for both the p-d hybridization strength and the NRR performance.The maximum free energy change(ΔG_(max))andΔd-p have a volcanic relationship with OsC_(4)(Se)_(4)located at the apex of the volcanic curve,showing the best NRR performance.The asymmetrical coordination environment could regulate the band structure subtly in terms of band overlap and positions.This work may shed new light on the application of orbital engineering in electrocatalytic NRR activity and especially promotes the rational design for SACs.

Enhancing rock fragmentation prediction in mining operations:A hybrid GWO-RF model with SHAP interpretability

In the mining industry,precise forecasting of rock fragmentation is critical for optimising blasting processes.In this study,we address the challenge of enhancing rock fragmentation assessment by developing a novel hybrid predictive model named GWO-RF.This model combines the grey wolf optimization(GWO)algorithm with the random forest(RF)technique to predict the D_(80)value,a critical parameter in evaluating rock fragmentation quality.The study is conducted using a dataset from Sarcheshmeh Copper Mine,employing six different swarm sizes for the GWO-RF hybrid model construction.The GWO-RF model’s hyperparameters are systematically optimized within established bounds,and its performance is rigorously evaluated using multiple evaluation metrics.The results show that the GWO-RF hybrid model has higher predictive skills,exceeding traditional models in terms of accuracy.Furthermore,the interpretability of the GWO-RF model is enhanced through the utilization of SHapley Additive exPlanations(SHAP)values.The insights gained from this research contribute to optimizing blasting operations and rock fragmentation outcomes in the mining industry.

Dual-ion carrier storage through Mg^(2+) addition for high-energy and long-life zinc-ion hybrid capacitor

Cation additives can efficiently enhance the total electrochemical capabilities of zinc-ion hybrid capacitors (ZHCs).However their energy storage mechanisms in zinc-based systems are still under debate.Herein,we modulate the electrolyte and achieve dual-ion storage by adding magnesium ions.And we assemble several Zn//activated carbon devices with different electrolyte concentrations and investigate their electrochemical reaction dynamic behaviors.The zinc-ion capacitor with Mg^(2+)mixed solution delivers 82 mAh·g^(-1)capacity at 1 A·g^(-1) and maintains 91%of the original capacitance after 10000 cycling.It is superior to the other assembled zinc-ion devices in single-component electrolytes.The finding demonstrates that the double-ion storage mechanism enables the superior rate performance and long cycle lifetime of ZHCs.

Electrostatic Interaction-directed Construction of Hierarchical Nanostructured Carbon Composite with Dual Electrical Conductive Networks for Zinc-ion Hybrid Capacitors with Ultrastability

Metal-organic framework(MOF)-derived carbon composites have been considered as the promising materials for energy storage.However,the construction of MOF-based composites with highly controllable mode via the liquid-liquid synthesis method has a great challenge because of the simultaneous heterogeneous nucleation on substrates and the self-nucleation of individual MOF nanocrystals in the liquid phase.Herein,we report a bidirectional electrostatic generated self-assembly strategy to achieve the precisely controlled coatings of single-layer nanoscale MOFs on a range of substrates,including carbon nanotubes(CNTs),graphene oxide(GO),MXene,layered double hydroxides(LDHs),MOFs,and SiO_(2).The obtained MOF-based nanostructured carbon composite exhibits the hierarchical porosity(V_(meso)/V_(micro)∶2.4),ultrahigh N content of 12.4 at.%and"dual electrical conductive networks."The assembled aqueous zinc-ion hybrid capacitor(ZIC)with the prepared nanocarbon composite as a cathode shows a high specific capacitance of 236 F g^(-1)at 0.5 A g^(-1),great rate performance of 98 F g^(-1)at 100 A g^(-1),and especially,an ultralong cycling stability up to 230000 cycles with the capacitance retention of 90.1%.This work develops a repeatable and general method for the controlled construction of MOF coatings on various functional substrates and further fabricates carbon composites for ZICs with ultrastability.

Hybrid手术对Stanford B型主动脉夹层疗效的研究进展

主动脉夹层主要通过使用假体移植物的开胸手术修复来治疗。在过去的10年里,胸主动脉腔内修复术(TEVAR)已成为一种创伤更小、潜在更安全的治疗方法。然而,单一的微创腔内修复术在缺乏足够的锚定区的Stanford B型主动脉夹层(TBAD)患者上有其局限性。因此,结合了外科手术及胸主动脉腔内修复术的Hy‐brid手术(或称为杂交手术),通过外科手段重建左颈总动脉和左锁骨下动脉的弓上分流术,再结合微创腔内修复术,显著减少患者在外科手术中并发症的发生率,且提高了那些常规胸主动脉腔内修复术缺乏理想锚定区患者的生存率。