Intelligent Fault Diagnosis Method of Rolling Bearings Based on Transfer Residual Swin Transformer with Shifted Windows

Due to their robust learning and expression ability for complex features,the deep learning(DL)model plays a vital role in bearing fault diagnosis.However,since there are fewer labeled samples in fault diagnosis,the depth of DL models in fault diagnosis is generally shallower than that of DL models in other fields,which limits the diagnostic performance.To solve this problem,a novel transfer residual Swin Transformer(RST)is proposed for rolling bearings in this paper.RST has 24 residual self-attention layers,which use the hierarchical design and the shifted window-based residual self-attention.Combined with transfer learning techniques,the transfer RST model uses pre-trained parameters from ImageNet.A new end-to-end method for fault diagnosis based on deep transfer RST is proposed.Firstly,wavelet transform transforms the vibration signal into a wavelet time-frequency diagram.The signal’s time-frequency domain representation can be represented simultaneously.Secondly,the wavelet time-frequency diagram is the input of the RST model to obtain the fault type.Finally,our method is verified on public and self-built datasets.Experimental results show the superior performance of our method by comparing it with a shallow neural network.

Deep Residual Joint Transfer Strategy for Cross-Condition Fault Diagnosis of Rolling Bearings

Rolling bearings are key components of the drivetrain in wind turbines,and their health is critical to wind turbine operation.In practical diagnosis tasks,the vibration signal is usually interspersed with many disturbing components,and the variation of operating conditions leads to unbalanced data distribution among different conditions.Although intelligent diagnosis methods based on deep learning have been intensively studied,it is still challenging to diagnose rolling bearing faults with small amounts of samples.To address the above issue,we introduce the deep residual joint transfer strategy method for the cross-condition fault diagnosis of rolling bearings.One-dimensional vibration signals are pre-processed by overlapping feature extraction techniques to fully extract fault characteristics.The deep residual network is trained in training tasks with sufficient samples,for fault pattern classification.Subsequently,three transfer strategies are used to explore the generalizability and adaptability of the pre-trained models to the data distribution in target tasks.Among them,the feature transferability between different tasks is explored by model transfer,and it is validated that minimizing data differences of tasks through a dual-stream adaptation structure helps to enhance generalization of the models to the target tasks.In the experiments of rolling bearing faults with unbalanced data conditions,localized faults of motor bearings and planet bearings are successfully identified,and good fault classification results are achieved,which provide guidance for the cross-condition fault diagnosis of rolling bearings with small amounts of training data.

Rolling Bearing Fault Diagnosis Based On Convolutional Capsule Network

Fault diagnosis technology has been widely applied and is an important part of ensuring the safe operation of mechanical equipment.In response to the problem of frequent faults in rolling bearings,this paper designs a rolling bearing fault diagnosis method based on convolutional capsule network(CCN).More specifically,the original vibration signal is converted into a two-dimensional time–frequency image using continuous wavelet transform(CWT),and the feature extraction is performed on the two-dimensional time–frequency image using the convolution layer at the front end of the network,and the extracted features are input into the capsule network.The capsule network converts the extracted features into vector neurons,and the dynamic routing algorithm is used to achieve feature transfer and output the results of fault diagnosis.Two different datasets are used to compare with other traditional deep learning models to verify the fault diagnosis capability of the method.The results show that the CCN has good diagnostic capability under different working conditions,even in the presence of noise and insufficient samples,compared to other models.This method contributes to the safe and reliable operation of mechanical equipment and is suitable for other rotating scenarios.

A Novel Deep Model with Meta-Learning for Rolling Bearing Few-Shot Fault Diagnosis

Machine learning,especially deep learning,has been highly successful in data-intensive applications;however,the performance of these models will drop significantly when the amount of the training data amount does not meet the requirement.This leads to the so-called few-shot learning(FSL)problem,which requires the model rapidly generalize to new tasks that containing only a few labeled samples.In this paper,we proposed a new deep model,called deep convolutional meta-learning networks,to address the low performance of generalization under limited data for bearing fault diagnosis.The essential of our approach is to learn a base model from the multiple learning tasks using a support dataset and finetune the learnt parameters using few-shot tasks before it can adapt to the new learning task based on limited training data.The proposed method was compared to several FSL methods,including methods with and without pre-training the embedding mapping,and methods with finetuning the classifier or the whole model by utilizing the few-shot data from the target domain.The comparisons are carried out on 1-shot and 10-shot tasks using the Case Western Reserve University bearing dataset and a cylindrical roller bearing dataset.The experimental result illustrates that our method has good performance on the bearing fault diagnosis across various few-shot conditions.In addition,we found that the pretraining process does not always improve the prediction accuracy.

Attention mechanism based multi-scale feature extraction of bearing fault diagnosis

Effective bearing fault diagnosis is vital for the safe and reliable operation of rotating machinery.In practical applications,bearings often work at various rotational speeds as well as load conditions.Yet,the bearing fault diagnosis under multiple conditions is a new subject,which needs to be further explored.Therefore,a multi-scale deep belief network(DBN)method integrated with attention mechanism is proposed for the purpose of extracting the multi-scale core features from vibration signals,containing four primary steps:preprocessing of multi-scale data,feature extraction,feature fusion,and fault classification.The key novelties include multi-scale feature extraction using multi-scale DBN algorithm,and feature fusion using attention mecha-nism.The benchmark dataset from University of Ottawa is applied to validate the effectiveness as well as advantages of this method.Furthermore,the aforementioned method is compared with four classical fault diagnosis methods reported in the literature,and the comparison results show that our pro-posed method has higher diagnostic accuracy and better robustness.

RMA-CNN:A Residual Mixed Domain Attention CNN for Bearings Fault Diagnosis and Its Time-Frequency Domain Interpretability

Early fault diagnosis of bearings is crucial for ensuring safe and reliable operations.Convolutional neural networks(CNNs)have achieved significant breakthroughs in machinery fault diagnosis.However,complex and varying working conditions can lead to inter-class similarity and intra-class variability in datasets,making it more challenging for CNNs to learn discriminative features.Furthermore,CNNs are often considered“black boxes”and lack sufficient interpretability in the fault diagnosis field.To address these issues,this paper introduces a residual mixed domain attention CNN method,referred to as RMA-CNN.This method comprises multiple residual mixed domain attention modules(RMAMs),each employing one attention mechanism to emphasize meaningful features in both time and channel domains.This significantly enhances the network’s ability to learn fault-related features.Moreover,we conduct an in-depth analysis of the inherent feature learning mechanism of the attention module RMAM to improve the interpretability of CNNs in fault diagnosis applications.Experiments conducted on two datasets—a high-speed aeronautical bearing dataset and a motor bearing dataset—demonstrate that the RMA-CNN achieves remarkable results in diagnostic tasks.

Rolling bearing fault diagnostics based on improved data augmentation and ConvNet

Convolutional neural networks(CNNs)are well suited to bearing fault classification due to their ability to learn discriminative spectro-temporal patterns.However,gathering sufficient cases of faulty conditions in real-world engineering scenarios to train an intelligent diagnosis system is challenging.This paper proposes a fault diagnosis method combining several augmentation schemes to alleviate the problem of limited fault data.We begin by identifying relevant parameters that influence the construction of a spectrogram.We leverage the uncertainty principle in processing time-frequency domain signals,making it impossible to simultaneously achieve good time and frequency resolutions.A key determinant of this phenomenon is the window function's choice and length used in implementing the shorttime Fourier transform.The Gaussian,Kaiser,and rectangular windows are selected in the experimentation due to their diverse characteristics.The overlap parameter's size also influences the outcome and resolution of the spectrogram.A 50%overlap is used in the original data transformation,and±25%is used in implementing an effective augmentation policy to which two-stage regular CNN can be applied to achieve improved performance.The best model reaches an accuracy of 99.98%and a cross-domain accuracy of 92.54%.When combined with data augmentation,the proposed model yields cutting-edge results.

Vibration-based bearing fault diagnosis of high-speed trains:A literature review

Due to the advantages of comfort and safety,high-speed trains are gradually becoming the mainstream public transport in China.Since the operating speed and mileage of high-speed trains have achieved rapid growth,it is more and more urgent to ensure their reliability and safety.As an important component in the bogies of highspeed trains,the health state of the bearing directly affects the operational safety of the trains.It is therefore necessary to diagnoze the faults of bearings in the bogies of high-speed trains as early as possible.In this paper,the bearing fault diagnostic methods for high-speed trains have been systematically summarized with their challenges and perspectives.First,it briefly introduces the structure of bearings in the bogies as well as the fault characteristic frequencies.Then,a brief review of the research on vibration-based signal processing methods and machine learning methods has been provided.Finally,the challenges and future developments of vibrationbased bearing fault diagnostic methods for high-speed trains have been analyzed.

An Inter-Shaft Bearing Fault Diagnosis Dataset from an Aero-Engine System

In this paper,the aero-engine test with inter-shaft bearing fault is carried out,and a dataset is proposed for the first time based on the vibration signal of rotors and casings.First,a test rig based on a real aero-engine is established,driven by motors and equipped with a lubricating system.Then,the aero-engine is disassembled and assembled following the specification process,and the inter-shaft bearing with artificial fault is replaced.Next,the aero-engine test is conducted at 28 groups of high-and low-pressure speeds.Six measuring points are arranged,including two displacement sensors to test the displacement vibration signals of the low-pressure rotor and four acceleration sensors to test the acceleration vibration signals of the casing.The test results are integrated into an inter-shaft bearing fault dataset.Finally,based on the dataset in this paper,frequency spectrum,envelope spectrum,CNN,LSTM,and TST are used for fault diagnosis,and the results are compared with those of CWRU and XJTU datasets.The results show that the characteristic fault frequency cannot be found directly in the spectrum and envelope spectrum corresponding to this paper’s dataset but in CWRU and XJTU datasets.Using CNN,LSTM,and TST for fault diagnosis of the dataset in this paper,the accuracy is 83.13%,85.41%,and 71.07%,respectively,much lower than the diagnosis results of CWRU and XJTU datasets.It can be seen that the dataset in this paper is closer to the actual fault diagnosis situation and is a more challenging dataset.This dataset provides a new benchmark for the validation of fault diagnosis methods.Mendeley data:https://github.com/HouLeiHIT/HIT-dataset.

Bearing Fault Diagnosis Based on Graph Formulation and Graph Convolutional Network

Bearing fault diagnosis stands as a critical component in the maintenance of rotating machinery.Many prevalent deep learning techniques are tailored to Euclidean datasets such as audio,image,and video.However,these methods falter when confronting non-Euclidean datasets,notably graph representations.In response,here we introduce an innovative approach harnessing the graph convolutional network(GCN)to analyze graph data derived from vibration signals related to bearing faults.This enhances the precision and reliability of fault diagnosis.Our methodology initiates by deriving a periodogram from the unprocessed vibration signals.Subsequently,this periodogram is mapped into a graph format,upon which the GCN is engaged for classification purposes.We substantiate the efficacy of our approach through rigorous experimental assessments conducted on a collection of ten bearing sets.Within these experiments,an accelerometer chronicles vibration signals across varying load conditions.We probe into the diagnostic accuracy rates across diverse loads and signal-to-noise ratios.Furthermore,a comparative evaluation of our method against several established algorithms delineated in this study is undertaken.Empirical observations confirm that our GCN-based strategy registers an elevated diagnostic accuracy quotient.

Quantitative Diagnosis of Fault Severity Trend of Rolling Element Bearings

The condition monitoring and fault diagnosis of rolling element bearings are particularly crucial in rotating mechanical applications in industry. A bearing fault signal contains information not only about fault condition and fault type but also the severity of the fault. This means fault severity quantitative analysis is one of most active and valid ways to realize proper maintenance decision. Aiming at the deficiency of the research in bearing single point pitting fault quantitative diagnosis, a new back-propagation neural network method based on wavelet packet decomposition coefficient entropy is proposed. The three levels of wavelet packet coefficient entropy（WPCE） is introduced as a characteristic input vector to the BPNN. Compared with the wavelet packet decomposition energy ratio input vector, WPCE shows more sensitive in distinguishing from the different fault severity degree of the measured signal. The engineering application results show that the quantitative trend fault diagnosis is realized in the different fault degree of the single point bearing pitting fault. The breakthrough attempt from quantitative to qualitative on the pattern recognition of rolling element bearings fault diagnosis is realized.

Application of Improved Deep Auto-Encoder Network in Rolling Bearing Fault Diagnosis

Since the effectiveness of extracting fault features is not high under traditional bearing fault diagnosis method, a bearing fault diagnosis method based on Deep Auto-encoder Network (DAEN) optimized by Cloud Adaptive Particle Swarm Optimization (CAPSO) was proposed. On the basis of analyzing CAPSO and DAEN, the CAPSO-DAEN fault diagnosis model is built. The model uses the randomness and stability of CAPSO algorithm to optimize the connection weight of DAEN, to reduce the constraints on the weights and extract fault features adaptively. Finally, efficient and accurate fault diagnosis can be implemented with the Softmax classifier. The results of test show that the proposed method has higher diagnostic accuracy and more stable diagnosis results than those based on the DAEN, Support Vector Machine (SVM) and the Back Propagation algorithm (BP) under appropriate parameters.

Weak Fault Diagnosis of Rolling Bearing Based on Improved Stochastic Resonance

Stochastic resonance can use noise to enhance weak signals,effectively reducing the effect of noise signals on feature extraction.In order to improve the early fault recognition rate of rolling bearings,and to overcome the shortcomings of lack of interaction in the selection of SR(Stochastic Resonance)method parameters and the lack of validation of the extracted features,an adaptive genetic random resonance early fault diagnosis method for rolling bearings was proposed.compared with the existing methods,the AGSR(Adaptive Genetic Stochastic Resonance)method uses genetic algorithms to optimize the system parameters,and further optimizes the parameters while considering the interaction between the parameters.This method can effectively extract the weak fault features of the bearing.In order to verify the effect of feature extraction,the feature signal extracted by AGSR method was input into the Fully connected neural network for fault diagnosis.the practicality of the algorithm is verified by simulation data and rolling bearing experimental data.the results show that the proposed method can effectively detect the early weak features of rolling bearings,and the fault diagnosis effect is better than the existing methods.

Fault Early Diagnosis of Rolling Element Bearings Combining Wavelet Filtering and Degree of Cyclostationarity Analysis

The vibration signals of rolling element bearing are produced by a combination of periodic and random processes due to the machine’s rotation cycle and interaction with the real world. The combination of such components can give rise to signals, which have periodically time-varying ensemble statistical and are best considered as cyclostationary. When the early fault occurs, the background noise is very heavy, it is difficult to disclose the latent periodic components successfully using cyclostationary analysis alone. In this paper the degree of cyclostationarity is combined with wavelet filtering for detection of rolling element bearing early faults. Using the proposed entropy minimization rule. The parameters of the wavelet filter are optimized. This method is shown to be effective in detecting rolling element bearing early fault when cyclostationary analysis by itself fails.

Application of Xgboost Feature Extraction in Fault Diagnosis of Rolling Bearing

Due to the difficulty that excessive feature dimension in fault diagnosis of rolling bearing will lead to the decrease of classification accuracy,a fault diagnosis method based on Xgboost algorithm feature extraction is proposed.When the Xgboost algorithm classifies features,it generates an order of importance of the input features.The time domain features were extracted from the vibration signal of the rolling bearing,the time-frequency features were formed by the singular value of the modal components that were decomposed by the variational mode decomposition.Firstly,the extracted time domain and time-frequency domain features were input into the support vector machine respectively to observe the fault diagnosis accuracy.Then,Xgboost algorithm was used to rank the importance of features and got the accuracy of fault diagnosis.Finally,important features were extracted and the extracted features were input into the support vector machine to observe the fault diagnosis accuracy.The result shows that the fault diagnosis accuracy of rolling bearing is improved after important feature extraction in time domain and time-frequency domain by Xgboost.

Long-Range Dependencies Learning Based on Nonlocal 1D-Convolutional Neural Network for Rolling Bearing Fault Diagnosis

In the field of data-driven bearing fault diagnosis,convolutional neural network(CNN)has been widely researched and applied due to its superior feature extraction and classification ability.However,the convolutional operation could only process a local neighborhood at a time and thus lack the ability of capturing long-range dependencies.Therefore,building an efficient learning method for long-range dependencies is crucial to comprehend and express signal features considering that the vibration signals obtained in a real industrial environment always have strong instability,periodicity,and temporal correlation.This paper introduces nonlocal mean to the CNN and presents a 1D nonlocal block(1D-NLB)to extract long-range dependencies.The 1D-NLB computes the response at a position as a weighted average value of the features at all positions.Based on it,we propose a nonlocal 1D convolutional neural network(NL-1DCNN)aiming at rolling bearing fault diagnosis.Furthermore,the 1D-NLB could be simply plugged into most existing deep learning architecture to improve their fault diagnosis ability.Under multiple noise conditions,the 1D-NLB improves the performance of the CNN on the wheelset bearing data set of high-speed train and the Case Western Reserve University bearing data set.The experiment results show that the NL-1DCNN exhibits superior results compared with six state-of-the-art fault diagnosis methods.

IGIgram:An Improved Gini Index-Based Envelope Analysis for Rolling Bearing Fault Diagnosis

The transient impulse features caused by rolling bearing faults are often present in the resonance frequency band which is closely related to the dynamic characteristics of the machine structure.Informative frequency band identification is a crucial prerequisite for envelope analysis and thereby accurate fault diagnosis of rolling bearings.In this paper,based on the ratio of quasi-arithmetic means and Gini index,improved Gini indices(IGIs)are proposed to quantify the transient impulse features of a signal,and their effectiveness and advantages in sparse quantification are confirmed by simulation analysis and comparisons with traditional sparsity measures.Furthermore,an IGI-based envelope analysis method named IGIgram is developed for fault diagnosis of rolling bearings.In the new method,an IGI-based indicator is constructed to evaluate the impulsiveness and cyclostationarity of the narrow-band filtered signal simultaneously,and then a frequency band with abundant fault information is adaptively determined for extracting bearing fault features.The performance of the IGIgram method is verified on the simulation signal and railway bearing experimental signals and compared with typical sparsity measures-based envelope analysis methods and log-cycligram.The results demonstrate that the proposed IGIs are efficient in quantifying bearing fault-induced transient features and the IGIgram method with appropriate power exponent can effectively achieve the diagnostics of different axle-box bearing faults.

A New Method of Wind Turbine Bearing Fault Diagnosis Based on Multi-Masking Empirical Mode Decomposition and Fuzzy C-Means Clustering

Based on Multi-Masking Empirical Mode Decomposition (MMEMD) and fuzzy c-means (FCM) clustering, a new method of wind turbine bearing fault diagnosis FCM-MMEMD is proposed, which can determine the fault accurately and timely. First, FCM clustering is employed to classify the data into different clusters, which helps to estimate whether there is a fault and how many fault types there are. If fault signals exist, the fault vibration signals are then demodulated and decomposed into different frequency bands by MMEMD in order to be analyzed further. In order to overcome the mode mixing defect of empirical mode decomposition (EMD), a novel method called MMEMD is proposed. It is an improvement to masking empirical mode decomposition (MEMD). By adding multi-masking signals to the signals to be decomposed in different levels, it can restrain low-frequency components from mixing in highfrequency components effectively in the sifting process and then suppress the mode mixing. It has the advantages of easy implementation and strong ability of suppressing modal mixing. The fault type is determined by Hilbert envelope finally. The results of simulation signal decomposition showed the high performance of MMEMD. Experiments of bearing fault diagnosis in wind turbine bearing fault diagnosis proved the validity and high accuracy of the new method.

Fault Analysis of Wind Power Rolling Bearing Based on EMD Feature Extraction

In a wind turbine,the rolling bearing is the critical component.However,it has a high failure rate.Therefore,the failure analysis and fault diagnosis of wind power rolling bearings are very important to ensure the high reliability and safety of wind power equipment.In this study,the failure form and the corresponding reason for the failure are discussed firstly.Then,the natural frequency and the characteristic frequency are analyzed.The Empirical Mode Decomposition(EMD)algorithm is used to extract the characteristics of the vibration signal of the rolling bearing.Moreover,the eigenmode function is obtained and then filtered by the kurtosis criterion.Consequently,the relationship between the actual fault frequency spectrum and the theoretical fault frequency can be obtained.Then the fault analysis is performed.To enhance the accuracy of fault diagnosis,based on the previous feature extraction and the time-frequency domain feature extraction of the data after EMD decomposition processing,four different classifiers are added to diagnose and classify the fault status of rolling bearings and compare them with four different classifiers.

Frequency Loss and Recovery in Rolling Bearing Fault Detection

Rolling element bearings are key components of mechanical equipment. The bearing fault characteristics are a ected by the interaction in the vibration signals. The low harmonics of the bearing characteristic frequencies cannot be usually observed in the Fourier spectrum. The frequency loss in the bearing vibration signal is presented through two independent experiments in this paper. The existence of frequency loss phenomenon in the low frequencies, side band frequencies and resonant frequencies and revealed. It is demonstrated that the lost frequencies are actually suppressed by the internal action in the bearing fault signal rather than the external interference. The amplitude and distribution of the spectrum are changed due to the interaction of the bearing fault signal. The interaction mechanism of bearing fault signal is revealed through theoretical and practical analysis. Based on mathematical morphology, a new method is provided to recover the lost frequencies. The multi-resonant response signal of the defective bearing are decomposed into low frequency and high frequency response, and the lost frequencies are recovered by the combination morphological filter(CMF). The e ectiveness of the proposed method is validated on simulated and experimental data.