Remaining Useful Life Prediction for a Roller in a Hot Strip Mill Based on Deep Recurrent Neural Networks

Accurate estimation of the remaining useful life(RUL)and health state for rollers is of great significance to hot rolling production.It can provide decision support for roller management so as to improve the productivity of the hot rolling process.In addition,the RUL prediction for rollers is helpful in transitioning from the current regular maintenance strategy to conditional-based maintenance.Therefore,a new method that can extract coarse-grained and fine-grained features from batch data to predict the RUL of the rollers is proposed in this paper.Firstly,a new deep learning network architecture based on recurrent neural networks that can make full use of the extracted coarsegrained fine-grained features to estimate the heath indicator(HI)is developed,where the HI is able to indicate the health state of the roller.Following that,a state-space model is constructed to describe the HI,and the probabilistic distribution of RUL can be estimated by extrapolating the HI degradation model to a predefined failure threshold.Finally,application to a hot strip mill is given to verify the effectiveness of the proposed methods using data collected from an industrial site,and the relatively low RMSE and MAE values demonstrate its advantages compared with some other popular deep learning methods.

Remaining Useful Life Prediction With Partial Sensor Malfunctions Using Deep Adversarial Networks

In recent years,intelligent data-driven prognostic methods have been successfully developed,and good machinery health assessment performance has been achieved through explorations of data from multiple sensors.However,existing datafusion prognostic approaches generally rely on the data availability of all sensors,and are vulnerable to potential sensor malfunctions,which are likely to occur in real industries especially for machines in harsh operating environments.In this paper,a deep learning-based remaining useful life(RUL)prediction method is proposed to address the sensor malfunction problem.A global feature extraction scheme is adopted to fully exploit information of different sensors.Adversarial learning is further introduced to extract generalized sensor-invariant features.Through explorations of both global and shared features,promising and robust RUL prediction performance can be achieved by the proposed method in the testing scenarios with sensor malfunctions.The experimental results suggest the proposed approach is well suited for real industrial applications.

Remaining useful life prediction for a nonlinear multi-degradation system with public noise

To predict the remaining useful life(RUL) for a class of nonlinear multi-degradation systems, a method is presented. In the real industrial processes, systems are usually composed by several parts or components, and these parts or components are working in the same environment, thus the degradations of these parts or components will be influenced by common factors. To describe such a phenomenon in degradations, a multi-degradation model with public noise is proposed. To identify the degradation states and the unknown parameters, an iterative estimation method is proposed by using the Kalman filter and the expectation maximization(EM) algorithm. Next, with known thresholds,the RUL of each degradation can be predicted by using the first hitting time(FHT). In addition, the RUL of the whole system can be obtained by a Copula function. Finally, a practical case is used to demonstrate the method proposed.

A Risk-Averse Remaining Useful Life Estimation for Predictive Maintenance

Remaining useful life(RUL)prediction is an advanced technique for system maintenance scheduling.Most of existing RUL prediction methods are only interested in the precision of RUL estimation;the adverse impact of overestimated RUL on maintenance scheduling is not of concern.In this work,an RUL estimation method with risk-averse adaptation is developed which can reduce the over-estimation rate while maintaining a reasonable under-estimation level.The proposed method includes a module of degradation feature selection to obtain crucial features which reflect system degradation trends.Then,the latent structure between the degradation features and the RUL labels is modeled by a support vector regression(SVR)model and a long short-term memory(LSTM)network,respectively.To enhance the prediction robustness and increase its marginal utility,the SVR model and the LSTM model are integrated to generate a hybrid model via three connection parameters.By designing a cost function with penalty mechanism,the three parameters are determined using a modified grey wolf optimization algorithm.In addition,a cost metric is proposed to measure the benefit of such a risk-averse predictive maintenance method.Verification is done using an aero-engine data set from NASA.The results show the feasibility and effectiveness of the proposed RUL estimation method and the predictive maintenance strategy.

Remaining useful lifetime prediction for equipment based on nonlinear implicit degradation modeling

Nonlinearity and implicitness are common degradation features of the stochastic degradation equipment for prognostics.These features have an uncertain effect on the remaining useful life(RUL)prediction of the equipment.The current data-driven RUL prediction method has not systematically studied the nonlinear hidden degradation modeling and the RUL distribution function.This paper uses the nonlinear Wiener process to build a dual nonlinear implicit degradation model.Based on the historical measured data of similar equipment,the maximum likelihood estimation algorithm is used to estimate the fixed coefficients and the prior distribution of a random coefficient.Using the on-site measured data of the target equipment,the posterior distribution of a random coefficient and actual degradation state are step-by-step updated based on Bayesian inference and the extended Kalman filtering algorithm.The analytical form of the RUL distribution function is derived based on the first hitting time distribution.Combined with the two case studies,the proposed method is verified to have certain advantages over the existing methods in the accuracy of prediction.

A Hybrid Ensemble Deep Learning Approach for Early Prediction of Battery Remaining Useful Life

Accurate estimation of the remaining useful life(RUL)of lithium-ion batteries is critical for their large-scale deployment as energy storage devices in electric vehicles and stationary storage.A fundamental understanding of the factors affecting RUL is crucial for accelerating battery technology development.However,it is very challenging to predict RUL accurately because of complex degradation mechanisms occurring within the batteries,as well as dynamic operating conditions in practical applications.Moreover,due to insignificant capacity degradation in early stages,early prediction of battery life with early cycle data can be more difficult.In this paper,we propose a hybrid deep learning model for early prediction of battery RUL.The proposed method can effectively combine handcrafted features with domain knowledge and latent features learned by deep networks to boost the performance of RUL early prediction.We also design a non-linear correlation-based method to select effective domain knowledge-based features.Moreover,a novel snapshot ensemble learning strategy is proposed to further enhance model generalization ability without increasing any additional training cost.Our experimental results show that the proposed method not only outperforms other approaches in the primary test set having a similar distribution as the training set,but also generalizes well to the secondary test set having a clearly different distribution with the training set.The PyTorch implementation of our proposed approach is available at https://github.com/batteryrul/battery_rul_early_prediction.

Remaining Useful Life Prediction of Aeroengine Based on Principal Component Analysis and One-Dimensional Convolutional Neural Network

In order to directly construct the mapping between multiple state parameters and remaining useful life(RUL),and reduce the interference of random error on prediction accuracy,a RUL prediction model of aeroengine based on principal component analysis(PCA)and one-dimensional convolution neural network(1D-CNN)is proposed in this paper.Firstly,multiple state parameters corresponding to massive cycles of aeroengine are collected and brought into PCA for dimensionality reduction,and principal components are extracted for further time series prediction.Secondly,the 1D-CNN model is constructed to directly study the mapping between principal components and RUL.Multiple convolution and pooling operations are applied for deep feature extraction,and the end-to-end RUL prediction of aeroengine can be realized.Experimental results show that the most effective principal component from the multiple state parameters can be obtained by PCA,and the long time series of multiple state parameters can be directly mapped to RUL by 1D-CNN,so as to improve the efficiency and accuracy of RUL prediction.Compared with other traditional models,the proposed method also has lower prediction error and better robustness.

A model to determining the remaining useful life of rotating equipment,based on a new approach to determining state of degradation

Condition assessment is one of the most significant techniques of the equipment’s health management.Also,in PHM methodology cycle,which is a developed form of CBM,condition assessment is the most important step of this cycle.In this paper,the remaining useful life of the equipment is calculated using the combination of sensor information,determination of degradation state and forecasting the proposed health index.The combination of sensor information has been carried out using a new approach to determining the probabilities in the Dempster-Shafer combination rules and fuzzy c-means clustering method.Using the simulation and forecasting of extracted vibration-based health index by autoregressive Markov regime switching(ARMRS)method,final health state is determined and the remaining useful life(RUL)is estimated.In order to evaluate the model,sensor data provided by FEMTO-ST Institute have been used.

A Novel Product Remaining Useful Life Prediction Approach Considering Fault Effects

In this paper,a novel remaining useful life prediction approach considering fault effects is proposed.The Wiener process is used to construct the degradation process of single performance characteristic with the fault effects.The first passage time based remaining useful life distribution is calculated by assuming fault occurrence moment is a random variable and follows a certain distribution.Expectation maximization algorithm is employed to estimate model parameters,where the fault occurrence moment is considered as a missing data.Finally,a Copula function is used to describe the dependence between the multiple performance characteristics and derive joint remaining useful life(RUL)distribution of product with the fault effects.The effectiveness of the proposed approach is verified by the experiments of turbofan engines.

Degradation data-driven approach for remaining useful life estimation

Remaining useful life （RUL） estimation is termed as one of the key issues in prognostics and health management （PHM）. To achieve RUL estimation for individual equipment, we present a degradation data-driven RUL estimation approach under the collaboration between Bayesian updating and expectation maximization （EM） algorithm. Firstly, we utilize an exponential-like degradation model to describe equipment degradation process and update stochastic parameters in the model via Bayesian approach. Based on the Bayesian updating results, both probability distribution of the RUL and its point estimation can be derived. Secondly, based on the monitored degradation data to date, we give a parameter estimation approach for non-stochastic parameters in the degradation model and prove that the obtained estimation is unique and optimal in each iteration. Finally, a numerical example and a practical case study for global positioning system （GPS） receiver are provided to show that the presented approach can model degradation process and achieve RUL estimation effectively and generate better results than a previously reported approach in literature.

Remaining useful life prediction based on nonlinear random coefficient regression model with fusing failure time data

Remaining useful life(RUL) prediction is one of the most crucial elements in prognostics and health management(PHM). Aiming at the imperfect prior information, this paper proposes an RUL prediction method based on a nonlinear random coefficient regression(RCR) model with fusing failure time data.Firstly, some interesting natures of parameters estimation based on the nonlinear RCR model are given. Based on these natures,the failure time data can be fused as the prior information reasonably. Specifically, the fixed parameters are calculated by the field degradation data of the evaluated equipment and the prior information of random coefficient is estimated with fusing the failure time data of congeneric equipment. Then, the prior information of the random coefficient is updated online under the Bayesian framework, the probability density function(PDF) of the RUL with considering the limitation of the failure threshold is performed. Finally, two case studies are used for experimental verification. Compared with the traditional Bayesian method, the proposed method can effectively reduce the influence of imperfect prior information and improve the accuracy of RUL prediction.

Remaining useful life prediction of aero-engines based on random-coefficient regression model considering random failure threshold

Remaining useful life(RUL)prediction is one of the most crucial components in prognostics and health management(PHM)of aero-engines.This paper proposes an RUL prediction method of aero-engines considering the randomness of failure threshold.Firstly,a random-coefficient regression(RCR)model is used to model the degradation process of aeroengines.Then,the RUL distribution based on fixed failure threshold is derived.The prior parameters of the degradation model are calculated by a two-step maximum likelihood estimation(MLE)method and the random coefficient is updated in real time under the Bayesian framework.The failure threshold in this paper is defined by the actual degradation process of aeroengines.After that,a expectation maximization(EM)algorithm is proposed to estimate the underlying failure threshold of aeroengines.In addition,the conditional probability is used to satisfy the limitation of failure threshold.Then,based on above results,an analytical expression of RUL distribution of aero-engines based on the RCR model considering random failure threshold(RFT)is derived in a closed-form.Finally,a case study of turbofan engine is used to demonstrate the effectiveness and superiority of the RUL prediction method and the parameters estimation method of failure threshold proposed.

Remaining Useful Life Estimation of Lithium-Ion Battery Based on Gaussian Mixture Ensemble Kalman Filter

The remaining useful life(RUL)prediction is a crucial indicator for the lithium-ion battery health prognostic.The particle filter(PF),used together with an empirical model,has become one of the most well-accepted techniques for RUL prediction.In this work,a novel filtering algorithm,named the Gaussian mixture model(GMM)-ensemble Kalman filter(EnKF)is proposed.It embeds the Gaussian mixture model in the EnKF framework to cope with the non-Gaussian feature of the system state space,and meanwhile address some of the major shortcomings of the PF.The GMM-EnKF and the PF are both applied on public data sets for RUL prediction and the simulation results show superiority of our proposed approach to the PF.

Enhanced vision-transformer integrating with semi-supervised transfer learning for state of health and remaining useful life estimation of lithium-ion batteries

The state of health(SOH)and remaining useful life(RUL)of lithium-ion batteries are crucial for health management and diagnosis.However,most data-driven estimation methods heavily rely on scarce labeled data,while traditional transfer learning faces challenges in handling domain shifts across various battery types.This paper proposes an enhanced vision-transformer integrating with semi-supervised transfer learning for SOH and RUL estimation of lithium-ion batteries.A depth-wise separable convolutional vision-transformer is developed to extract local aging details with depth-wise convolutions and establishes global dependencies between aging information using multi-head attention.Maximum mean discrepancy is employed to initially reduce the distribution difference between the source and target domains,providing a superior starting point for fine-tuning the target domain model.Subsequently,the abundant aging data of the same type as the target battery are labeled through semi-supervised learning,compensating for the source model's limitations in capturing target battery aging characteristics.Consistency regularization incorporates the cross-entropy between predictions with and without adversarial perturbations into the gradient backpropagation of the overall model.In particular,across the experimental groups 13–15 for different types of batteries,the root mean square error of SOH estimation was less than 0.66%,and the mean relative error of RUL estimation was 3.86%.Leveraging extensive unlabeled aging data,the proposed method could achieve accurate estimation of SOH and RUL.

Path Classification and Estimation Model Based Prognosis of Pneumatic Cylinder Lifetime

Prognosis is a key technology to improve reliability,safety and maintainability of products,a lot of researchers have been devoted to this technology.But to improve the predict accuracy of remaining life of products has been difficult.To predict the lifetime specification of pneumatic cylinders with high reliability and long lifetime and small specimen,this paper put forward the prognosis algorithm based on the path classification and estimation（PACE） model.PACE model is based entirely on failure data instead of failure threshold.Pneumatic cylinders normally characterize with failure mechanism wear and tear.Since the minimum working pressure increases with the number of working cycles,the minimum working pressure is chosen as degradation signal.PACE model is fundamentally composed of two operations：path classification and remaining useful life（RUL） estimation.Path classification is to classify a current degradation path as belonging to one or more of previously collected exemplary degradation paths.RUL estimation is to use the resulting memberships to estimate the remaining useful life.In order for verification and validation of PACE prognostic method,six pneumatic cylinders are tested.The test data is analyzed by PACE prognostics.It is found that the PACE based prognosis method has higher prediction accuracy and smaller variance and PACE model is significantly outperform population based prognostics especially for small specimen condition.PACE model based method solved the problem of prediction accuracy for small specimen pneumatic cylinders＇ prognosis.

An adaptive-order particle filter for remaining useful life prediction of aviation piston pumps

An accurate estimation of the remaining useful life（RUL） not only contributes to an effective application of an aviation piston pump, but also meets the necessity of condition based maintenance（CBM）. For the current RUL evaluation methods, a model-based method is inappropriate for the degradation process of an aviation piston pump due to difficulties of modeling, while a data-based method rarely presents high-accuracy prediction in a long period of time. In this work,an adaptive-order particle filter（AOPF） prognostic process is proposed aiming at improving long-term prediction accuracy of RUL by combining both kinds of methods. A dynamic model is initialized by a data-driven or empirical method. When a new observation comes, the prior state distribution is approximated by a current model. The order of the current model is updated adaptively by fusing the information of the observation. Monte Carlo simulation is employed for estimating the posterior probability density function of future states of the pump＇s degradation.With updating the order number adaptively, the method presents a higher precision in contrast with those of traditional methods. In a case study, the proposed AOPF method is adopted to forecast the degradation status of an aviation piston pump with experimental return oil flow data, and the analytical results show the effectiveness of the proposed AOPF method.

Remaining useful life prediction based on variation coefficient consistency test of a Wiener process

High-cost equipment is often reused after maintenance, and whether the information before the maintenance can be used for the Remaining Useful Life （RUL） prediction after the maintenance is directly determined by the consistency of the degradation pattern before and after the maintenance. Aiming at this problem, an RUL prediction method based on the consistency test of a Wiener process is proposed. Firstly, the parameters of the Wiener process estimated by Maximum Likelihood Estimation （MLE） are proved to be biased, and a modified unbiased estimation method is proposed and verified by derivation and simulations. Then, the h statistic is constructed according to the reciprocal of the variation coefficient of the Wiener process, and the sampling distribution is derived. Meanwhile, a universal method for the consistency test is proposed based on the sampling distribution theorem, which is verified by simulation data and classical crack degradation data. Finally, based on the consistency test of the degradation model, a weighted fusion RUL prediction method is presented for the fuel pump of an airplane, and the validity of the presented method is verified by accurate computation results of real data, which provides a theoretical and practical guidance for engineers to predict the RUL of equipment after maintenance.

Remaining Useful Life Prediction of Turbofan Engine Using Hybrid Model Based on Autoencoder and Bidirectional Long Short-Term Memory

Turbofan engine is a critical aircraft component with complex structure and high-reliability requirements. Effectively predicting the remaining useful life(RUL) of turbofan engines has essential significance for developing maintenance strategies and reducing maintenance costs. Considering the characteristics of large sample size and high dimension of monitoring data, a hybrid health condition prediction model integrating the advantages of autoencoder and bidirectional long short-term memory(BLSTM) is proposed to improve the prediction accuracy of RUL. Autoencoder is used as a feature extractor to compress condition monitoring data. BLSTM is designed to capture the bidirectional long-range dependencies of features. A hybrid deep learning prediction model of RUL is constructed. This model has been tested on a benchmark dataset. The results demonstrate that this autoencoder-BLSTM hybrid model has a better prediction accuracy than the existing methods, such as multi-layer perceptron(MLP), support vector regression(SVR), convolutional neural network(CNN) and long short-term memory(LSTM). The proposed model can provide strong support for the health management and maintenance strategy development of turbofan engines.

A Regularized LSTM Method for Predicting Remaining Useful Life of Rolling Bearings

Rotating machinery is important to industrial production. Any failure of rotating machinery, especially the failure of rolling bearings, can lead to equipment shutdown and even more serious incidents. Therefore, accurate residual life prediction plays a crucial role in guaranteeing machine operation safety and reliability and reducing maintenance cost. In order to increase the forecasting precision of the remaining useful life(RUL) of the rolling bearing, an advanced approach combining elastic net with long short-time memory network(LSTM) is proposed, and the new approach is referred to as E-LSTM. The E-LSTM algorithm consists of an elastic mesh and LSTM, taking temporal-spatial correlation into consideration to forecast the RUL through the LSTM. To solve the over-fitting problem of the LSTM neural network during the training process, the elastic net based regularization term is introduced to the LSTM structure.In this way, the change of the output can be well characterized to express the bearing degradation mode. Experimental results from the real-world data demonstrate that the proposed E-LSTM method can obtain higher stability and relevant values that are useful for the RUL forecasting of bearing. Furthermore, these results also indicate that E-LSTM can achieve better performance.

State of health and remaining useful life prediction for lithiumion batteries based on differential thermal voltammetry and a long and short memory neural network

As the lithium-ion battery is widely applied,the reliability of the battery has become a high-profile content in recent years.Accurate estimation and prediction of state of health(SOH)and remaining useful life(RUL)prediction are crucial for battery management systems.In this paper,the core contribution is the construction of a datadriven model with the long short-term memory(LSTM)network applicable to the time-series regression prediction problem with the integration of two methods,data-driven methods and feature signal analysis.The input features of model are extracted from differential thermal voltammetry(DTV)curves,which could characterize the battery degradation characteristics,so that the accurate prediction of battery capacity fade could be accomplished.Firstly,the DTV curve is smoothed by the Savitzky-Golay filter,and six alternate features are selected based on the connection between DTV curves and battery degradation characteristics.Then,a correlation analysis method is used to further filter the input features and three features that are highly associated with capacity fade are selected as input into the data driven model.The LSTM neural network is trained by using the root mean square propagation(RMSprop)technique and the dropout technique.Finally,the data of four batteries with different health levels are deployed for model construction,verification and comparison.The results show that the proposed method has high accuracy in SOH and RUL prediction and the capacity rebound phenomenon can be accurately estimated.This method can greatly reduce the cost and complexity,and increase the practicability,which provides the basis and guidance for battery data collection and the application of cloud technology and digital twin.