Effects of data smoothing and recurrent neural network(RNN)algorithms for real-time forecasting of tunnel boring machine(TBM)performance

Tunnel boring machines(TBMs)have been widely utilised in tunnel construction due to their high efficiency and reliability.Accurately predicting TBM performance can improve project time management,cost control,and risk management.This study aims to use deep learning to develop real-time models for predicting the penetration rate(PR).The models are built using data from the Changsha metro project,and their performances are evaluated using unseen data from the Zhengzhou Metro project.In one-step forecast,the predicted penetration rate follows the trend of the measured penetration rate in both training and testing.The autoregressive integrated moving average(ARIMA)model is compared with the recurrent neural network(RNN)model.The results show that univariate models,which only consider historical penetration rate itself,perform better than multivariate models that take into account multiple geological and operational parameters(GEO and OP).Next,an RNN variant combining time series of penetration rate with the last-step geological and operational parameters is developed,and it performs better than other models.A sensitivity analysis shows that the penetration rate is the most important parameter,while other parameters have a smaller impact on time series forecasting.It is also found that smoothed data are easier to predict with high accuracy.Nevertheless,over-simplified data can lose real characteristics in time series.In conclusion,the RNN variant can accurately predict the next-step penetration rate,and data smoothing is crucial in time series forecasting.This study provides practical guidance for TBM performance forecasting in practical engineering.

Data-Driven Modeling for Wind Turbine Blade Loads Based on Deep Neural Network

Blades are essential components of wind turbines.Reducing their fatigue loads during operation helps to extend their lifespan,but it is difficult to quickly and accurately calculate the fatigue loads of blades.To solve this problem,this paper innovatively designs a data-driven blade load modeling method based on a deep learning framework through mechanism analysis,feature selection,and model construction.In the mechanism analysis part,the generation mechanism of blade loads and the load theoretical calculationmethod based on material damage theory are analyzed,and four measurable operating state parameters related to blade loads are screened;in the feature extraction part,15 characteristic indicators of each screened parameter are extracted in the time and frequency domain,and feature selection is completed through correlation analysis with blade loads to determine the input parameters of data-driven modeling;in the model construction part,a deep neural network based on feedforward and feedback propagation is designed to construct the nonlinear coupling relationship between the unit operating parameter characteristics and blade loads.The results show that the proposed method mines the wind turbine operating state characteristics highly correlated with the blade load,such as the standard deviation of wind speed.The model built using these characteristics has reasonable calculation and fitting capabilities for the blade load and shows a better fitting level for untrained out-of-sample data than the traditional scheme.Based on the mean absolute percentage error calculation,the modeling accuracy of the two blade loads can reach more than 90%and 80%,respectively,providing a good foundation for the subsequent optimization control to suppress the blade load.

Forecasting model of residential load based on general regression neural network and PSO-Bayes least squares support vector machine

Firstly,general regression neural network(GRNN) was used for variable selection of key influencing factors of residential load(RL) forecasting.Secondly,the key influencing factors chosen by GRNN were used as the input and output terminals of urban and rural RL for simulating and learning.In addition,the suitable parameters of final model were obtained through applying the evidence theory to combine the optimization results which were calculated with the PSO method and the Bayes theory.Then,the model of PSO-Bayes least squares support vector machine(PSO-Bayes-LS-SVM) was established.A case study was then provided for the learning and testing.The empirical analysis results show that the mean square errors of urban and rural RL forecast are 0.02% and 0.04%,respectively.At last,taking a specific province RL in China as an example,the forecast results of RL from 2011 to 2015 were obtained.

A Levenberg–Marquardt Based Neural Network for Short-Term Load Forecasting

Short-term load forecasting (STLF) is part and parcel of theefficient working of power grid stations. Accurate forecasts help to detect thefault and enhance grid reliability for organizing sufficient energy transactions.STLF ranges from an hour ahead prediction to a day ahead prediction. Variouselectric load forecasting methods have been used in literature for electricitygeneration planning to meet future load demand. A perfect balance regardinggeneration and utilization is still lacking to avoid extra generation and misusageof electric load. Therefore, this paper utilizes Levenberg–Marquardt(LM) based Artificial Neural Network (ANN) technique to forecast theshort-term electricity load for smart grids in a much better, more precise,and more accurate manner. For proper load forecasting, we take the mostcritical weather parameters along with historical load data in the form of timeseries grouped into seasons, i.e., winter and summer. Further, the presentedmodel deals with each season’s load data by splitting it into weekdays andweekends. The historical load data of three years have been used to forecastweek-ahead and day-ahead load demand after every thirty minutes makingload forecast for a very short period. The proposed model is optimized usingthe Levenberg-Marquardt backpropagation algorithm to achieve results withcomparable statistics. Mean Absolute Percent Error (MAPE), Root MeanSquared Error (RMSE), R2, and R are used to evaluate the model. Comparedwith other recent machine learning-based mechanisms, our model presentsthe best experimental results with MAPE and R2 scores of 1.3 and 0.99,respectively. The results prove that the proposed LM-based ANN modelperforms much better in accuracy and has the lowest error rates as comparedto existing work.

Hybrid partial least squares and neural network approach for short-term electrical load forecasting

Intelligent systems and methods such as the neural network （NN） are usually used in electric power systems for short-term electrical load forecasting. However, a vast amount of electrical load data is often redundant, and linearly or nonlinearly correlated with each other. Highly correlated input data can result in erroneous prediction results given out by an NN model. Besides this, the determination of the topological structure of an NN model has always been a problem for designers. This paper presents a new artificial intelligence hybrid procedure for next day electric load forecasting based on partial least squares （PLS） and NN. PLS is used for the compression of data input space, and helps to determine the structure of the NN model. The hybrid PLS-NN model can be used to predict hourly electric load on weekdays and weekends. The advantage of this methodology is that the hybrid model can provide faster convergence and more precise prediction results in comparison with abductive networks algorithm. Extensive testing on the electrical load data of the Puget power utility in the USA confirms the validity of the proposed approach.

Comparison of Electric Load Forecasting between Using SOM and MLP Neural Network

Electric load forecasting has been a major area of research in the last decade since the production of accurate short-term forecasts for electricity loads has proven to be a key to success for many of the decision makers in the energy sector, from power generation to operation of the system. The objective of this research is to analyze the capacity of the MLP （multilayer perceptron neural network） versus SOM （self-organizing map neural network） for short-term load forecasting. The MLP is one of the most commonly used networks. It can be used for classification problems, model construction, series forecasting and discrete control. On the other hand, the SOM is a type of artificial neural network that is trained using unsupervised data to produce a low-dimensional, discretized representation of an input space of training samples in a cell map. Historical data of real global load demand were used for the research. Both neural models provide good prediction results, but the results obtained with the SOM maps are markedly better Also the main advantage of SOM maps is that they reach good results as a network unsupervised. It is much easier to train and interpret the results.

Short-term load forecasting based on fuzzy neural network

The fuzzy neural network is applied to the short-term load forecasting. The fuzzy rules and fuzzy membership functions of the network are obtained through fuzzy neural network learming. Three inference algorithms, i.e. themultiplicative inference, the maximum inference and the minimum inference, are used for comparison. The learningalgorithms corresponding to the inference methods are derived from back-propagation algorithm. To validate the fuzzyneural network model, the network is used to Predict short-term load by compaing the network output against the realload data from a local power system supplying electricity to a large steel manufacturer. The experimental results aresatisfactory.

Short-Term Load Forecasting Using Radial Basis Function Neural Network

An accurate short-term forecasting method for load of electric power system can help the electric power system’s operator to reduce the risk of unreliability of electricity supply. This paper proposed a radial basis function (RBF) neural network method to forecast the short-term load of electric power system. To demonstrate the effectiveness of the proposed method, the method is tested on the practical load data information of the Tai power system. The good agreements between the realistic values and forecasting values are obtained;the numerical results show that the proposed forecasting method is accurate and reliable.

TIME SERIES NEURAL NETWORK MODEL FOR HYDROLOGIC FORECASTING

Time series analysis plays an important role in hydrologic forecasting,while the key to this analysis is to establish a proper model.This paper presents a time series neural network model with back propagation procedure for hydrologic forecasting.Free from the disadvantages of previous models,the model can be parallel to operate information flexibly and rapidly.It excels in the ability of nonlinear mapping and can learn and adjust by itself,which gives the model a possibility to describe the complex nonlinear hydrologic process.By using directly a training process based on a set of previous data, the model can forecast the time series of stream flow.Moreover,two practical examples were used to test the performance of the time series neural network model.Results confirm that the model is efficient and feasible.

STUDY ON ARTIFICIAL NEURAL NETWORK FORECASTING METHOD OF WATER CONSUMPTION PER HOUR

An artificial neural network (ANN) short term forecasting model of consumption per hour was built based on seasonality,trend and randomness of a city period of time water consumption series.Different hidden layer nodes,same inputs and forecasting data were selected to train and forecast and then the relative errors were compared so as to confirm the NN structure.A model was set up and used to forecast concretely by Matlab.It is tested by examples and compared with the result of time series trigonometric function analytical method.The result indicates that the prediction errors of NN are small and the velocity of forecasting is fast.It can completely meet the actual needs of the control and run of the water supply system.

River channel flood forecasting method of coupling wavelet neural network with autoregressive model

Based on analyzing the limitations of the commonly used back-propagation neural network （BPNN）, a wavelet neural network （WNN） is adopted as the nonlinear river channel flood forecasting method replacing the BPNN. The WNN has the characteristics of fast convergence and improved capability of nonlinear approximation. For the purpose of adapting the timevarying characteristics of flood routing, the WNN is coupled with an AR real-time correction model. The AR model is utilized to calculate the forecast error. The coefficients of the AR real-time correction model are dynamically updated by an adaptive fading factor recursive least square（RLS） method. The application of the flood forecasting method in the cross section of Xijiang River at Gaoyao shows its effectiveness.

Study on Pests Forecasting Using the Method of Neural Network Based on Fuzzy Clustering

Aimed to the characters of pests forecast such as fuzziness, correlation, nonlinear and real-time as well as decline of generalization capacity of neural network in prediction with few observations, a method of pests forecasting using the method of neural network based on fuzzy clustering was proposed in this experiment. The simulation results demonstrated that the method was simple and practical and could forecast pests fast and accurately, particularly, the method could obtain good results with few samples and samples correlation.

Non-crossing Quantile Regression Neural Network as a Calibration Tool for Ensemble Weather Forecasts

Despite the maturity of ensemble numerical weather prediction(NWP),the resulting forecasts are still,more often than not,under-dispersed.As such,forecast calibration tools have become popular.Among those tools,quantile regression(QR)is highly competitive in terms of both flexibility and predictive performance.Nevertheless,a long-standing problem of QR is quantile crossing,which greatly limits the interpretability of QR-calibrated forecasts.On this point,this study proposes a non-crossing quantile regression neural network(NCQRNN),for calibrating ensemble NWP forecasts into a set of reliable quantile forecasts without crossing.The overarching design principle of NCQRNN is to add on top of the conventional QRNN structure another hidden layer,which imposes a non-decreasing mapping between the combined output from nodes of the last hidden layer to the nodes of the output layer,through a triangular weight matrix with positive entries.The empirical part of the work considers a solar irradiance case study,in which four years of ensemble irradiance forecasts at seven locations,issued by the European Centre for Medium-Range Weather Forecasts,are calibrated via NCQRNN,as well as via an eclectic mix of benchmarking models,ranging from the naïve climatology to the state-of-the-art deep-learning and other non-crossing models.Formal and stringent forecast verification suggests that the forecasts post-processed via NCQRNN attain the maximum sharpness subject to calibration,amongst all competitors.Furthermore,the proposed conception to resolve quantile crossing is remarkably simple yet general,and thus has broad applicability as it can be integrated with many shallow-and deep-learning-based neural networks.

Application of Artificial Neural Networks to Rainfall Forecasting in Queensland,Australia

In this study, the application of artificial intelligence to monthly and seasonal rainfall forecasting in Queensland, Australia, was assessed by inputting recognized climate indices, monthly historical rainfall data, and atmospheric temperatures into a prototype stand-alone, dynamic, recurrent, time-delay, artificial neural network. Outputs, as monthly rainfall forecasts 3 months in advance for the period 1993 to 2009, were compared with observed rainfall data using time-series plots, root mean squared error （RMSE）, and Pearson correlation coefficients. A comparison of RMSE values with forecasts generated by the Australian Bureau of Meteorology＇s Predictive Ocean Atmosphere Model for Australia （POAMA）-I.5 general circulation model （GCM） indicated that the prototype achieved a lower RMSE for 16 of the 17 sites compared. The application of artificial neural networks to rainfall forecasting was reviewed. The prototype design is considered preliminary, with potential for significant improvement such as inclusion of output from GCMs and experimentation with other input attributes.

Application of artificial neural networks in optimal tuning of tuned mass dampers implemented in high-rise buildings subjected to wind load

High-rise buildings are usually considered as flexible structures with low inherent damping. Therefore, these kinds of buildings are susceptible to wind-induced vibration. Tuned Mass Damper（TMD） can be used as an effective device to mitigate excessive vibrations. In this study, Artificial Neural Networks is used to find optimal mechanical properties of TMD for high-rise buildings subjected to wind load. The patterns obtained from structural analysis of different multi degree of freedom（MDF） systems are used for training neural networks. In order to obtain these patterns, structural models of some systems with 10 to 80 degrees-of-freedoms are built in MATLAB/SIMULINK program. Finally, the optimal properties of TMD are determined based on the objective of maximum displacement response reduction. The Auto-Regressive model is used to simulate the wind load. In this way, the uncertainties related to wind loading can be taken into account in neural network’s outputs. After training the neural network, it becomes possible to set the frequency and TMD mass ratio as inputs and get the optimal TMD frequency and damping ratio as outputs. As a case study, a benchmark 76-story office building is considered and the presented procedure is used to obtain optimal characteristics of the TMD for the building.

A novel recurrent neural network forecasting model for power intelligence center

In order to accurately forecast the load of power system and enhance the stability of the power network, a novel unascertained mathematics based recurrent neural network (UMRNN) for power intelligence center (PIC) was created through three steps. First, by combining with the general project uncertain element transmission theory (GPUET), the basic definitions of stochastic, fuzzy, and grey uncertain elements were given based on the principal types of uncertain information. Second, a power dynamic alliance including four sectors: generation sector, transmission sector, distribution sector and customers was established. The key factors were amended according to the four transmission topologies of uncertain elements, thus the new factors entered the power intelligence center as the input elements. Finally, in the intelligence handing background of PIC, by performing uncertain and recursive process to the input values of network, and combining unascertained mathematics, the novel load forecasting model was built. Three different approaches were put forward to forecast an eastern regional power grid load in China. The root mean square error (ERMS) demonstrates that the forecasting accuracy of the proposed model UMRNN is 3% higher than that of BP neural network (BPNN), and 5% higher than that of autoregressive integrated moving average (ARIMA). Besides, an example also shows that the average relative error of the first quarter of 2008 forecasted by UMRNN is only 2.59%, which has high precision.

Load Reduction Test Method of Similarity Theory and BP Neural Networks of Large Cranes

Static load tests are an important means of supervising and detecting a crane＇s lift capacity. Due to space restrictions, however, there are difficulties and potential danger when testing large bridge cranes. To solve the loading problems of large-tonnage cranes during testing, an equivalency test is proposed based on the similarity theory and BP neural networks. The maximum stress and displacement of a large bridge crane is tested in small loads, combined with the training neural network of a similar structure crane through stress and displacement data which is collected by a physics simulation progressively loaded to a static load test load within the material scope of work. The maximum stress and displacement of a crane under a static load test load can be predicted through the relationship of stress, displacement, and load. By measuring the stress and displacement of small tonnage weights, the stress and displacement of large loads can be predicted, such as the maximum load capacity, which is 1.25 times the rated capacity. Experimental study shows that the load reduction test method can reflect the lift capacity of large bridge cranes. The load shedding predictive analysis for Sanxia 1200 t bridge crane test data indicates that when the load is 1.25 times the rated lifting capacity, the predicted displacement and actual displacement error is zero. The method solves the problem that lifting capacities are difficult to obtain and testing accidents are easily possible when 1.25 times related weight loads are tested for large tonnage cranes.

A forecasting model for wave heights based on a long short-term memory neural network

To explore new operational forecasting methods of waves,a forecasting model for wave heights at three stations in the Bohai Sea has been developed.This model is based on long short-term memory(LSTM)neural network with sea surface wind and wave heights as training samples.The prediction performance of the model is evaluated,and the error analysis shows that when using the same set of numerically predicted sea surface wind as input,the prediction error produced by the proposed LSTM model at Sta.N01 is 20%,18%and 23%lower than the conventional numerical wave models in terms of the total root mean square error(RMSE),scatter index(SI)and mean absolute error(MAE),respectively.Particularly,for significant wave height in the range of 3–5 m,the prediction accuracy of the LSTM model is improved the most remarkably,with RMSE,SI and MAE all decreasing by 24%.It is also evident that the numbers of hidden neurons,the numbers of buoys used and the time length of training samples all have impact on the prediction accuracy.However,the prediction does not necessary improve with the increase of number of hidden neurons or number of buoys used.The experiment trained by data with the longest time length is found to perform the best overall compared to other experiments with a shorter time length for training.Overall,long short-term memory neural network was proved to be a very promising method for future development and applications in wave forecasting.

Wind speed forecasting based on wavelet decomposition and wavelet neural networks optimized by the Cuckoo search algorithm

Wind speed forecasting is of great importance for wind farm management and plays an important role in grid integration. Wind speed is volatile in nature and therefore it is difficult to predict with a single model. In this study, three hybrid multi-step wind speed forecasting models are developed and compared — with each other and with earlier proposed wind speed forecasting models. The three models are based on wavelet decomposition(WD), the Cuckoo search(CS) optimization algorithm, and a wavelet neural network(WNN). They are referred to as CS-WD-ANN(artificial neural network), CS-WNN, and CS-WD-WNN, respectively. Wind speed data from two wind farms located in Shandong, eastern China, are used in this study. The simulation result indicates that CS-WD-WNN outperforms the other two models, with minimum statistical errors. Comparison with earlier models shows that CS-WD-WNN still performs best, with the smallest statistical errors. The employment of the CS optimization algorithm in the models shows improvement compared with the earlier models.

The Development of Highly Loaded Turbine Rotating Blades by Using 3D Optimization Design Method of Turbomachinery Blades Based on Artificial Neural Network & Genetic Algorithm

In order to improve turbine internal efficiency and lower manufacturing cost, a new highly loaded rotating blade has been developed. The 3D optimization design method based on artificial neural network and genetic algorithm is adopted to construct the blade shape. The blade is stacked by the center of gravity in radial direction with five sections. For each blade section, independent suction and pressure sides are constructed from the camber line using Bezier curves. Three-dimensional flow analysis is carried out to verify the performance of the new blade. It is found that the new blade has improved the blade performance by 0.5%. Consequently, it is verified that the new blade is effective to improve the turbine internal efficiency and to lower the turbine weight and manufacturing cost by reducing the blade number by about 15%.