A Hybrid Approach for Predicting the Remaining Useful Life of Bearings Based on the RReliefF Algorithm and Extreme Learning Machine

Accurately predicting the remaining useful life(RUL)of bearings in mining rotating equipment is vital for mining enterprises.This research aims to distinguish the features associated with the RUL of bearings and propose a prediction model based on these selected features.This study proposes a hybrid predictive model to assess the RUL of rolling element bearings.The proposed model begins with the pre-processing of bearing vibration signals to reconstruct sixty time-domain features.The hybrid model selects relevant features from the sixty time-domain features of the vibration signal by adopting the RReliefF feature selection algorithm.Subsequently,the extreme learning machine(ELM)approach is applied to develop a predictive model of RUL based on the optimal features.The model is trained by optimizing its parameters via the grid search approach.The training datasets are adjusted to make them most suitable for the regression model using the cross-validation method.The proposed hybrid model is analyzed and validated using the vibration data taken from the public XJTU-SY rolling element-bearing database.The comparison is constructed with other traditional models.The experimental test results demonstrated that the proposed approach can predict the RUL of bearings with a reliable degree of accuracy.

Remaining Useful Life Prediction of Rail Based on Improved Pulse Separable Convolution Enhanced Transformer Encoder

In order to prevent possible casualties and economic loss, it is critical to accurate prediction of the Remaining Useful Life (RUL) in rail prognostics health management. However, the traditional neural networks is difficult to capture the long-term dependency relationship of the time series in the modeling of the long time series of rail damage, due to the coupling relationship of multi-channel data from multiple sensors. Here, in this paper, a novel RUL prediction model with an enhanced pulse separable convolution is used to solve this issue. Firstly, a coding module based on the improved pulse separable convolutional network is established to effectively model the relationship between the data. To enhance the network, an alternate gradient back propagation method is implemented. And an efficient channel attention (ECA) mechanism is developed for better emphasizing the useful pulse characteristics. Secondly, an optimized Transformer encoder was designed to serve as the backbone of the model. It has the ability to efficiently understand relationship between the data itself and each other at each time step of long time series with a full life cycle. More importantly, the Transformer encoder is improved by integrating pulse maximum pooling to retain more pulse timing characteristics. Finally, based on the characteristics of the front layer, the final predicted RUL value was provided and served as the end-to-end solution. The empirical findings validate the efficacy of the suggested approach in forecasting the rail RUL, surpassing various existing data-driven prognostication techniques. Meanwhile, the proposed method also shows good generalization performance on PHM2012 bearing data set.

A Hybrid Ensemble Deep Learning Approach for Early Prediction of Battery Remaining Useful Life

Accurate estimation of the remaining useful life(RUL)of lithium-ion batteries is critical for their large-scale deployment as energy storage devices in electric vehicles and stationary storage.A fundamental understanding of the factors affecting RUL is crucial for accelerating battery technology development.However,it is very challenging to predict RUL accurately because of complex degradation mechanisms occurring within the batteries,as well as dynamic operating conditions in practical applications.Moreover,due to insignificant capacity degradation in early stages,early prediction of battery life with early cycle data can be more difficult.In this paper,we propose a hybrid deep learning model for early prediction of battery RUL.The proposed method can effectively combine handcrafted features with domain knowledge and latent features learned by deep networks to boost the performance of RUL early prediction.We also design a non-linear correlation-based method to select effective domain knowledge-based features.Moreover,a novel snapshot ensemble learning strategy is proposed to further enhance model generalization ability without increasing any additional training cost.Our experimental results show that the proposed method not only outperforms other approaches in the primary test set having a similar distribution as the training set,but also generalizes well to the secondary test set having a clearly different distribution with the training set.The PyTorch implementation of our proposed approach is available at https://github.com/batteryrul/battery_rul_early_prediction.

Remaining Useful Life Prediction of Rolling Element Bearings Based on Different Degradation Stages and Particle Filter

A method is proposed to improve the accuracy of remaining useful life prediction for rolling element bearings,based on a state space model(SSM)with different degradation stages and a particle filter.The model is improved by a method based on the Paris formula and the Foreman formula allowing the establishment of different degradation stages.The remaining useful life of rolling element bearings can be predicted by the adjusted model with inputs of physical data and operating status information.The late operating trend is predicted by the use of the particle filter algorithm.The rolling bearing full life experimental data validate the proposed method.Further,the prediction result is compared with the single SSM and the Gamma model,and the results indicate that the predicted accuracy of the proposed method is higher with better practicability.

Machine learning techniques for prediction of capacitance and remaining useful life of supercapacitors: A comprehensive review

Supercapacitors are appealing energy storage devices for their promising features like high power density,outstanding cycling stability,and a quick charge–discharge cycle.The exceptional life cycle and ultimate power capability of supercapacitors are needed in the transportation and renewable energy generation sectors.Hence,predicting the capacitance and lifecycle of supercapacitors is significant for selecting the suitable material and planning replacement intervals for supercapacitors.In addition,system failures can be better addressed by accurately forecasting the lifecycle of SCs.Recently,the use of machine learning for performance prediction of energy storage materials has drawn increasing attention from researchers globally because of its superiority in prediction accuracy,time efficiency,and costeffectiveness.This article presents a detailed review of the progress and advancement of ML techniques for the prediction of capacitance and remaining useful life(RUL)of supercapacitors.The review starts with an introduction to supercapacitor materials and ML applications in energy storage devices,followed by workflow for ML model building for supercapacitor materials.Then,the summary of machine learning applications for the prediction of capacitance and RUL of different supercapacitor materials including EDLCs(carbon based materials),pesudocapacitive(oxides and composites)and hybrid materials is presented.Finally,the general perspective for future directions is also presented.

Remaining Useful Life Prediction With Partial Sensor Malfunctions Using Deep Adversarial Networks

In recent years,intelligent data-driven prognostic methods have been successfully developed,and good machinery health assessment performance has been achieved through explorations of data from multiple sensors.However,existing datafusion prognostic approaches generally rely on the data availability of all sensors,and are vulnerable to potential sensor malfunctions,which are likely to occur in real industries especially for machines in harsh operating environments.In this paper,a deep learning-based remaining useful life(RUL)prediction method is proposed to address the sensor malfunction problem.A global feature extraction scheme is adopted to fully exploit information of different sensors.Adversarial learning is further introduced to extract generalized sensor-invariant features.Through explorations of both global and shared features,promising and robust RUL prediction performance can be achieved by the proposed method in the testing scenarios with sensor malfunctions.The experimental results suggest the proposed approach is well suited for real industrial applications.

Remaining useful life prediction based on nonlinear random coefficient regression model with fusing failure time data

Remaining useful life(RUL) prediction is one of the most crucial elements in prognostics and health management(PHM). Aiming at the imperfect prior information, this paper proposes an RUL prediction method based on a nonlinear random coefficient regression(RCR) model with fusing failure time data.Firstly, some interesting natures of parameters estimation based on the nonlinear RCR model are given. Based on these natures,the failure time data can be fused as the prior information reasonably. Specifically, the fixed parameters are calculated by the field degradation data of the evaluated equipment and the prior information of random coefficient is estimated with fusing the failure time data of congeneric equipment. Then, the prior information of the random coefficient is updated online under the Bayesian framework, the probability density function(PDF) of the RUL with considering the limitation of the failure threshold is performed. Finally, two case studies are used for experimental verification. Compared with the traditional Bayesian method, the proposed method can effectively reduce the influence of imperfect prior information and improve the accuracy of RUL prediction.

Research on Remaining Useful Life Prediction Method of Rolling Bearing Based on Health Indicator Extraction and Trajectory Enhanced Particle Filter

Aiming at the difficulty of mining fault prognosis starting points and constructing prognostic models for remaining useful life(RUL)prediction of rolling bearings,a RUL prediction method is proposed based on health indicator(HI)extraction and trajectory-enhanced particle filter(TE-PF).By extracting a HI that can accurately track the trending of bearing degradation and combining it with the early fault enhancement technology,early abnormal sample nodes can be mined to provide more samples with fault information for the construction and training of subsequent prediction models.Aiming at the problem that traditional degradation rate models based on PF are vulnerable to HI mutations,a TE-PF prediction method is proposed based on comprehensive utilization of historical degradation information to timely modify prediction model parameters.Results from a rolling bearing prognostic study show that prediction starting points can be accurately detected and a reasonable prediction model can be conveniently constructed by the RUL prediction method based on HI amplitude abnormal detection and TE-PF.Furthermore,aiming at the RUL prediction problem under the condition of HI mutation,RUL prediction with probability and statistics characteristics under a confidence interval can be obtained based on the method proposed.

Deep Spatiotemporal Convolutional-Neural-Network-Based Remaining Useful Life Estimation of Bearings

The remaining useful life(RUL)estimation of bearings is critical for ensuring the reliability of mechanical systems.Owing to the rapid development of deep learning methods,a multitude of data-driven RUL estimation approaches have been proposed recently.However,the following problems remain in existing methods:1)Most network models use raw data or statistical features as input,which renders it difficult to extract complex fault-related information hidden in signals;2)for current observations,the dependence between current states is emphasized,but their complex dependence on previous states is often disregarded;3)the output of neural networks is directly used as the estimated RUL in most studies,resulting in extremely volatile prediction results that lack robustness.Hence,a novel prognostics approach is proposed based on a time-frequency representation(TFR)subsequence,three-dimensional convolutional neural network(3DCNN),and Gaussian process regression(GPR).The approach primarily comprises two aspects:construction of a health indicator(HI)using the TFR-subsequence-3DCNN model,and RUL estimation based on the GPR model.The raw signals of the bearings are converted into TFR-subsequences by continuous wavelet transform and a dislocated overlapping strategy.Subsequently,the 3DCNN is applied to extract the hidden spatiotemporal features from the TFR-subsequences and construct HIs.Finally,the RUL of the bearings is estimated using the GPR model,which can also define the probability distribution of the potential function and prediction confidence.Experiments on the PRONOSTIA platform demonstrate the superiority of the proposed TFR-subsequence-3DCNN-GPR approach.The use of degradation-related spatiotemporal features in signals is proposed herein to achieve a highly accurate bearing RUL prediction with uncertainty quantification.

Fatigue Life Prediction of Rolling Bearings Based on Modified SWT Mean Stress Correction

The existing engineering empirical life analysis models are not capable of considering the constitutive behavior of materials under contact loads;as a consequence,these methods may not be accurate to predict fatigue lives of roll-ing bearings.In addition,the contact stress of bearing in operation is cyclically pulsating,it also means that the bear-ing undergo non-symmetrical fatigue loadings.Since the mean stress has great effects on fatigue life,in this work,a novel fatigue life prediction model based on the modified SWT mean stress correction is proposed as a basis of which to estimate the fatigue life of rolling bearings,in which,takes sensitivity of materials and mean stress into account.A compensation factor is introduced to overcome the inaccurate predictions resulted from the Smith,Watson,and Topper(SWT)model that considers the mean stress effect and sensitivity while assuming the sensitivity coefficient of all materials to be 0.5.Moreover,the validation of the model is finalized by several practical experimental data and the comparison to the conventional SWT model.The results show the better performance of the proposed model,especially in the accuracy than the existing SWT model.This research will shed light on a new direction for predicting the fatigue life of rolling bearings.

Effective Latent Representation for Prediction of Remaining Useful Life

AI approaches have been introduced to predict the remaining useful life(RUL)of a machine in modern industrial areas.To apply them well,challenges regarding the high dimension of the data space and noisy data should be met to improve model efficiency and accuracy.In this study,we propose an end-toend model,termed ACB,for RUL predictions;it combines an autoencoder,convolutional neural network(CNN),and bidirectional long short-term memory.A new penalized root mean square error loss function is included to avoid an overestimation of the RUL.With the CNN-based autoencoder,a high-dimensional data space can be mapped into a lower-dimensional latent space,and the noisy data can be greatly reduced.We compared ACB with five state-of-the-art models on the Commercial Modular Aero-Propulsion System Simulation dataset.Our model achieved the lowest score value on all four sub-datasets.The robustness of our model to noise is also supported by the experiments.

Rolling Bearing Remaining Useful Life Prediction Based on Wiener Process

Rolling bearing is the key part of mechanical system.Accurate prediction of bearing life can reduce maintenance costs,improve availability,and prevent catastrophic consequences,aiming at solving the problem of the nonlinear,random and small sample problems faced by rolling bearings in actual operating conditions.In this work,the nonlinearWiener process with random effect and unbiased estimation of unknown parameters is used to predict the remaining useful life of rolling bearings.Firstly,random effects and nonlinear parameters are added to the traditional Wiener process,and a parameter unbiased estimation method is used to estimate the positional parameters of the constructed Wiener model.Finally,the model is validated using a common set of bearing datasets.Experimental results show that compared with the traditional maximum likelihood function estimation method,the parameter unbiased estimation method can effectively improve the accuracy and stability of the parameter estimation results.The model has a good fitting effect,which can accurately predict the remaining useful life of rolling bearing.

Methods for predicting the remaining useful life of equipment in consideration of the random failure threshold

The value range of the failure threshold will generate an uncertain influence on the prediction results for the remaining useful life(RUL) of equipment. Most of the existing studies on the RUL prediction assume that the failure threshold is a fixed value,as they have difficulty in reflecting the random variation of the failure threshold. In connection with the inadequacies of the existing research, an in-depth analysis is carried out to study the effect of the random failure threshold(RFT) on the prediction results for the RUL. First, a nonlinear degradation model with unit-to-unit variability and measurement error is established based on the nonlinear Wiener process. Second, the expectation-maximization(EM) algorithm is used to solve the estimated values of the parameters of the prior degradation model, and the Bayesian method is used to iteratively update the posterior distribution of the random coefficients. Then, the effects of three types of RFT constraint conditions on the prediction results for the RUL are analyzed, and the probability density function(PDF) of the RUL is derived. Finally,the degradation data of aero-turbofan engines are used to verify the correctness and advantages of the method.

Remaining useful lifetime prediction for equipment based on nonlinear implicit degradation modeling

Nonlinearity and implicitness are common degradation features of the stochastic degradation equipment for prognostics.These features have an uncertain effect on the remaining useful life(RUL)prediction of the equipment.The current data-driven RUL prediction method has not systematically studied the nonlinear hidden degradation modeling and the RUL distribution function.This paper uses the nonlinear Wiener process to build a dual nonlinear implicit degradation model.Based on the historical measured data of similar equipment,the maximum likelihood estimation algorithm is used to estimate the fixed coefficients and the prior distribution of a random coefficient.Using the on-site measured data of the target equipment,the posterior distribution of a random coefficient and actual degradation state are step-by-step updated based on Bayesian inference and the extended Kalman filtering algorithm.The analytical form of the RUL distribution function is derived based on the first hitting time distribution.Combined with the two case studies,the proposed method is verified to have certain advantages over the existing methods in the accuracy of prediction.

Position Encoding Based Convolutional Neural Networks for Machine Remaining Useful Life Prediction

Accurate remaining useful life(RUL)prediction is important in industrial systems.It prevents machines from working under failure conditions,and ensures that the industrial system works reliably and efficiently.Recently,many deep learning based methods have been proposed to predict RUL.Among these methods,recurrent neural network(RNN)based approaches show a strong capability of capturing sequential information.This allows RNN based methods to perform better than convolutional neural network(CNN)based approaches on the RUL prediction task.In this paper,we question this common paradigm and argue that existing CNN based approaches are not designed according to the classic principles of CNN,which reduces their performances.Additionally,the capacity of capturing sequential information is highly affected by the receptive field of CNN,which is neglected by existing CNN based methods.To solve these problems,we propose a series of new CNNs,which show competitive results to RNN based methods.Compared with RNN,CNN processes the input signals in parallel so that the temporal sequence is not easily determined.To alleviate this issue,a position encoding scheme is developed to enhance the sequential information encoded by a CNN.Hence,our proposed position encoding based CNN called PE-Net is further improved and even performs better than RNN based methods.Extensive experiments are conducted on the C-MAPSS dataset,where our PE-Net shows state-of-the-art performance.

Practical Options for Adopting Recurrent Neural Network and Its Variants on Remaining Useful Life Prediction

The remaining useful life(RUL)of a system is generally predicted by utilising the data collected from the sensors that continuously monitor different indicators.Recently,different deep learning(DL)techniques have been used for RUL prediction and achieved great success.Because the data is often time-sequential,recurrent neural network(RNN)has attracted significant interests due to its efficiency in dealing with such data.This paper systematically reviews RNN and its variants for RUL prediction,with a specific focus on understanding how different components(e.g.,types of optimisers and activation functions)or parameters(e.g.,sequence length,neuron quantities)affect their performance.After that,a case study using the well-studied NASA’s C-MAPSS dataset is presented to quantitatively evaluate the influence of various state-of-the-art RNN structures on the RUL prediction performance.The result suggests that the variant methods usually perform better than the original RNN,and among which,Bi-directional Long Short-Term Memory generally has the best performance in terms of stability,precision and accuracy.Certain model structures may fail to produce valid RUL prediction result due to the gradient vanishing or gradient exploring problem if the parameters are not chosen appropriately.It is concluded that parameter tuning is a crucial step to achieve optimal prediction performance.

Dense-Structured Network Based Bearing Remaining Useful Life Prediction System

This work is focused on developing an effective method for bearing remaining useful life predictions.The method is useful in accurately predicting the remaining useful life of bearings so that machine damage,production outage,and human accidents caused by unexpected bearing failure can be prevented.This study uses the bearing dataset provided by FEMTO-ST Institute,Besancon,France.This study starts with the exploration of neural networks,based on which the biaxial vibration signals are modeled and analyzed.This paper introduces pre-processing of bearing vibration signals,neural network model training and adjustment of training data.The model is trained by optimizing model parameters and verifying its performance through cross-validation.The proposed model’s superiority is also confirmed through a comparison with other traditionalmodels.In this study,the neural network model is trained with various types of bearing data and can successfully predict the remaining useful life.The algorithm proposed in this study achieves a prediction accuracy of coefficient of determination as high as 0.99.

Predictive Maintenance of Manned Spacecraft Through Remaining Useful Life Estimation Technique

Manned spacecraft pose challenges in terms of extremely high safety and reliability, and with the growth of system complexity and longer on-orbit operation time, the traditional management mode, such as monitoring the threshold of parameter passively, is difficult to meet the required safety standards. Predictive maintenance, which analyzes the system heath trend and estimates remaining useful life(RUL) to establish maintenance strategies ahead of time before failure occurs, is a new mode to approach maintenance tasks. Here, a predictive maintenance strategy for complex manned spacecraft is proposed based on the remaining useful life estimation technique. Firstly, a health index is established based on an abundance of telemetry data, reflecting the system's current health state. Secondly, we map the health index to the remaining useful life through system degradation modelling, taking into consideration both the system's stochastic deterioration and uncertainty. The maintenance and management strategies are then made based on the calculated distribution of RUL time. Finally, a case study on Chinese space station energy system predictive maintenance is presented.

Residual Convolution Long Short-Term Memory Network for Machines Remaining Useful Life Prediction and Uncertainty Quantification

Recently,deep learning(DL)has been widely used in the field of remaining useful life(RUL)prediction.Among various DL technologies,recurrent neural network(RNN)and its variant,e.g.,long short-term memory(LSTM)network,have gained extensive attention for their ability to capture temporal dependence.Although existing RNN-based methods have demonstrated their RUL prediction effectiveness,they still suffer from the following two limitations:1)it is difficult for the RNN to directly extract degradation features from original monitoring data and 2)most RNN-based prognostics methods are unable to quantify RUL uncertainty.To address the aforementioned limitations,this paper proposes a new prognostics method named residual convolution LSTM(RC-LSTM)network.In the RC-LSTM,a new ResNet-based convolution LSTM(Res-ConvLSTM)layer is stacked with a convolution LSTM(ConvLSTM)layer to extract degradation representations from monitoring data.Then,under the assumption that the RUL follows a normal distribution,an appropriate output layer is constructed to quantify the uncertainty of prediction results.Finally,the effectiveness and superiority of the RC-LSTM are verified using monitoring data from accelerated bearing degradation tests.

A Risk-Averse Remaining Useful Life Estimation for Predictive Maintenance

Remaining useful life(RUL)prediction is an advanced technique for system maintenance scheduling.Most of existing RUL prediction methods are only interested in the precision of RUL estimation;the adverse impact of overestimated RUL on maintenance scheduling is not of concern.In this work,an RUL estimation method with risk-averse adaptation is developed which can reduce the over-estimation rate while maintaining a reasonable under-estimation level.The proposed method includes a module of degradation feature selection to obtain crucial features which reflect system degradation trends.Then,the latent structure between the degradation features and the RUL labels is modeled by a support vector regression(SVR)model and a long short-term memory(LSTM)network,respectively.To enhance the prediction robustness and increase its marginal utility,the SVR model and the LSTM model are integrated to generate a hybrid model via three connection parameters.By designing a cost function with penalty mechanism,the three parameters are determined using a modified grey wolf optimization algorithm.In addition,a cost metric is proposed to measure the benefit of such a risk-averse predictive maintenance method.Verification is done using an aero-engine data set from NASA.The results show the feasibility and effectiveness of the proposed RUL estimation method and the predictive maintenance strategy.