A Novel Hybrid Ensemble Learning Approach for Enhancing Accuracy and Sustainability in Wind Power Forecasting

Accurate wind power forecasting is critical for system integration and stability as renewable energy reliance grows.Traditional approaches frequently struggle with complex data and non-linear connections. This article presentsa novel approach for hybrid ensemble learning that is based on rigorous requirements engineering concepts.The approach finds significant parameters influencing forecasting accuracy by evaluating real-time Modern-EraRetrospective Analysis for Research and Applications (MERRA2) data from several European Wind farms usingin-depth stakeholder research and requirements elicitation. Ensemble learning is used to develop a robust model,while a temporal convolutional network handles time-series complexities and data gaps. The ensemble-temporalneural network is enhanced by providing different input parameters including training layers, hidden and dropoutlayers along with activation and loss functions. The proposed framework is further analyzed by comparing stateof-the-art forecasting models in terms of Root Mean Squared Error (RMSE) and Mean Absolute Error (MAE),respectively. The energy efficiency performance indicators showed that the proposed model demonstrates errorreduction percentages of approximately 16.67%, 28.57%, and 81.92% for MAE, and 38.46%, 17.65%, and 90.78%for RMSE for MERRAWind farms 1, 2, and 3, respectively, compared to other existingmethods. These quantitativeresults show the effectiveness of our proposed model with MAE values ranging from 0.0010 to 0.0156 and RMSEvalues ranging from 0.0014 to 0.0174. This work highlights the effectiveness of requirements engineering in windpower forecasting, leading to enhanced forecast accuracy and grid stability, ultimately paving the way for moresustainable energy solutions.

Non-crossing Quantile Regression Neural Network as a Calibration Tool for Ensemble Weather Forecasts

Despite the maturity of ensemble numerical weather prediction(NWP),the resulting forecasts are still,more often than not,under-dispersed.As such,forecast calibration tools have become popular.Among those tools,quantile regression(QR)is highly competitive in terms of both flexibility and predictive performance.Nevertheless,a long-standing problem of QR is quantile crossing,which greatly limits the interpretability of QR-calibrated forecasts.On this point,this study proposes a non-crossing quantile regression neural network(NCQRNN),for calibrating ensemble NWP forecasts into a set of reliable quantile forecasts without crossing.The overarching design principle of NCQRNN is to add on top of the conventional QRNN structure another hidden layer,which imposes a non-decreasing mapping between the combined output from nodes of the last hidden layer to the nodes of the output layer,through a triangular weight matrix with positive entries.The empirical part of the work considers a solar irradiance case study,in which four years of ensemble irradiance forecasts at seven locations,issued by the European Centre for Medium-Range Weather Forecasts,are calibrated via NCQRNN,as well as via an eclectic mix of benchmarking models,ranging from the naïve climatology to the state-of-the-art deep-learning and other non-crossing models.Formal and stringent forecast verification suggests that the forecasts post-processed via NCQRNN attain the maximum sharpness subject to calibration,amongst all competitors.Furthermore,the proposed conception to resolve quantile crossing is remarkably simple yet general,and thus has broad applicability as it can be integrated with many shallow-and deep-learning-based neural networks.

Growth and Interactions of Multi-Source Perturbations in Convection-Allowing Ensemble Forecasts

This study investigated the growth of forecast errors stemming from initial conditions(ICs),lateral boundary conditions(LBCs),and model(MO)perturbations,as well as their interactions,by conducting seven 36 h convectionallowing ensemble forecast(CAEF)experiments.Two cases,one with strong-forcing(SF)and the other with weak-forcing(WF),occurred over the Yangtze-Huai River basin(YHRB)in East China,were selected to examine the sources of uncertainties associated with perturbation growth under varying forcing backgrounds and the influence of these backgrounds on growth.The perturbations exhibited distinct characteristics in terms of temporal evolution,spatial propagation,and vertical distribution under different forcing backgrounds,indicating a dependence between perturbation growth and forcing background.A comparison of the perturbation growth in different precipitation areas revealed that IC and LBC perturbations were significantly influenced by the location of precipitation in the SF case,while MO perturbations were more responsive to convection triggering and dominated in the WF case.The vertical distribution of perturbations showed that the sources of uncertainties and the performance of perturbations varied between SF and WF cases,with LBC perturbations displaying notable case dependence.Furthermore,the interactions between perturbations were considered by exploring the added values of different source perturbations.For the SF case,the added values of IC,LBC,and MO perturbations were reflected in different forecast periods and different source uncertainties,suggesting that the combination of multi-source perturbations can yield positive interactions.In the WF case,MO perturbations provided a more accurate estimation of uncertainties downstream of the Dabie Mountain and need to be prioritized in the research on perturbation development.

Multi-model ensemble forecasting of 10-m wind speed over eastern China based on machine learning optimization

风对人类活动和电力运行有重大影响,准确预报短期风速具有深远的社会和经济意义.基于中国东部100个站点,本研究首先评估了5个业务模式对10米风速的预报能力,日本气象厅JMA模式在减少预报误差方面表现最好.进一步,利用5种数值模式和多种机器学习方法,将动力和统计相结合,对每个站点分别进行了特征工程和机器学习算法优选,建立了10米风速多模式集成预报模型。针对24至96小时预报时长,将该方法的预报性能与基于岭回归的多模式集成和JMA单模式进行比较.结果表明,基于机器学习优选的多模型集成方法可以将JMA模式的预报误差降低39%以上,预报效果的提升在11月最明显.此外,该方法优于基于岭回归的多模式集成方法.

Scientific Advances and Weather Services of the China Meteorological Administration’s National Forecasting Systems during the Beijing 2022 Winter Olympics

Since the Beijing 2022 Winter Olympics was the first Winter Olympics in history held in continental winter monsoon climate conditions across complex terrain areas,there is a deficiency of relevant research,operational techniques,and experience.This made providing meteorological services for this event particularly challenging.The China Meteorological Administration(CMA)Earth System Modeling and Prediction Centre,achieved breakthroughs in research on short-and medium-term deterministic and ensemble numerical predictions.Several key technologies crucial for precise winter weather services during the Winter Olympics were developed.A comprehensive framework,known as the Operational System for High-Precision Weather Forecasting for the Winter Olympics,was established.Some of these advancements represent the highest level of capabilities currently available in China.The meteorological service provided to the Beijing 2022 Games also exceeded previous Winter Olympic Games in both variety and quality.This included achievements such as the“100-meter level,minute level”downscaled spatiotemporal resolution and forecasts spanning 1 to 15 days.Around 30 new technologies and over 60 kinds of products that align with the requirements of the Winter Olympics Organizing Committee were developed,and many of these techniques have since been integrated into the CMA’s operational national forecasting systems.These accomplishments were facilitated by a dedicated weather forecasting and research initiative,in conjunction with the preexisting real-time operational forecasting systems of the CMA.This program represents one of the five subprograms of the WMO’s high-impact weather forecasting demonstration project(SMART2022),and continues to play an important role in their Regional Association(RA)II Research Development Project(Hangzhou RDP).Therefore,the research accomplishments and meteorological service experiences from this program will be carried forward into forthcoming highimpact weather forecasting activities.This article provides an overview and assessment of this program and the operational national forecasting systems.

The method of residual‑based bootstrap averaging of the forecast ensemble

This paper presents an optimization approach—residual-based bootstrap averaging(RBBA)—for different types of forecast ensembles.Unlike traditional residual-mean-square-error-based ensemble forecast averaging approaches,the RBBA method attempts to find optimal forecast weights in an ensemble and allows for their combi-nation into the most effective additive forecast.In the RBBA method,all the different types of forecasts obtain the optimal weights for ensemble residuals that are statisti-cally optimal in terms of the fitness function of the residuals.Empirical studies have been conducted to demonstrate why and how the RBBA method works.The experi-mental results based on the real-world time series of contemporary stock exchanges show that the RBBA method can produce ensemble forecasts with good generalization ability.

Significant wave height forecasts integrating ensemble empirical mode decomposition with sequence-to-sequence model

As wave height is an important parameter in marine climate measurement,its accurate prediction is crucial in ocean engineering.It also plays an important role in marine disaster early warning and ship design,etc.However,challenges in the large demand for computing resources and the improvement of accuracy are currently encountered.To resolve the above mentioned problems,sequence-to-sequence deep learning model(Seq-to-Seq)is applied to intelligently explore the internal law between the continuous wave height data output by the model,so as to realize fast and accurate predictions on wave height data.Simultaneously,ensemble empirical mode decomposition(EEMD)is adopted to reduce the non-stationarity of wave height data and solve the problem of modal aliasing caused by empirical mode decomposition(EMD),and then improves the prediction accuracy.A significant wave height forecast method integrating EEMD with the Seq-to-Seq model(EEMD-Seq-to-Seq)is proposed in this paper,and the prediction models under different time spans are established.Compared with the long short-term memory model,the novel method demonstrates increased continuity for long-term prediction and reduces prediction errors.The experiments of wave height prediction on four buoys show that the EEMD-Seq-to-Seq algorithm effectively improves the prediction accuracy in short-term(3-h,6-h,12-h and 24-h forecast horizon)and long-term(48-h and 72-h forecast horizon)predictions.

Ensemble Forecasting of Tropical Cyclone Motion Using a Baroclinic Model

The purpose of this study is to investigate the effectiveness of two different ensemble forecasting （EF） techniques-the lagged-averaged forecast （LAF） and the breeding of growing modes （BGM）. In the BGM experiments, the vortex and the environment are perturbed separately （named BGMV and BGME）. Tropical cyclone （TC） motions in two difficult situations are studied： a large vortex interacting with its environment, and an apparent binary interaction. The former is Typhoon Yancy and the latter involves Typhoon Ed and super Typhoon Flo, all occurring during the Tropical Cyclone Motion Experiment TCM- 90. The model used is the baroclinic model of the University of New South Wales. The lateral boundary tendencies are computed from atmospheric analysis data. Only the relative skill of the ensemble forecast mean over the control run is used to evaluate the effectiveness of the EF methods, although the EF technique is also usecl to quantify forecast uncertainty in some studies. In the case of Yancy, the ensemble mean forecasts of each of the three methodologies are better than that of the control, with LAF being the best. The mean track of the LAF is close to the best track, and it predicts landfall over Taiwan. The improvements in LAF and the full BGM where both the environment and vortex are perturbed suggest the importance of combining the perturbation of the vortex and environment when the interaction between the two is appreciable. In the binary interaction case of Ed and Flo, the forecasts of Ed appear to be insensitive to perturbations of the environment and/or the vortex, which apparently results from erroneous forecasts by the model of the interaction between the subtropical ridge and Ed, as well as from the interaction between the two typhoons, thus reducing the effectiveness of the EF technique. This conclusion is reached through sensitivity experiments on the domain of the model and by adding or eliminating certain features in the model atmosphere. Nevertheless, the forecast tracks in some of the cases are improved over that of the control. On the other hand, the EF technique has little impact on the forecasts of Flo because the control forecast is already very close to the best track. The study provides a basis for the. future development of the EF technique. The limitations of this study are also addressed. For example, the above results are based on a small sample, and the study is actually a simulation, which is different than operational forecasting. Further tests of these EF techniques are proposed.

The Use of Rank Histograms and MVL Diagrams to Characterize Ensemble Evolution in Weather Forecasting

Rank Histograms are suitable tools to assess the quality of ensembles within an ensemble prediction system or framework. By counting the rank of a given variable in the ensemble, we are basically making a sample analysis, which does not allow us to distinguish if the origin of its variability is external noise or comes from chaotic sources. The recently introduced Mean to Variance Logarithmic （MVL） Diagram accounts for the spatial variability, being very sensitive to the spatial localization produced by infinitesimal perturbations of spatiotemporal chaotic systems. By using as a benchmark a simple model subject to noise, we show the distinct information given by Rank Histograms and MVL Diagrams. Hence, the main effects of the external noise can be visualized in a graphic. From the MVL diagram we clearly observe a reduction of the amplitude growth rate and of the spatial localization （chaos suppression）, while from the Rank Histogram we observe changes in the reliability of the ensemble. We conclude that in a complex framework including spatiotemporal chaos and noise, both provide a more complete forecasting picture.

A Hybrid Neural Network Model for Marine Dissolved Oxygen Concentrations Time-Series Forecasting Based on Multi-Factor Analysis and a Multi-Model Ensemble

Dissolved oxygen(DO)is an important indicator of aquaculture,and its accurate forecasting can effectively improve the quality of aquatic products.In this paper,a new DO hybrid forecasting model is proposed that includes three stages:multi-factor analysis,adaptive decomposition,and an optimizationbased ensemble.First,considering the complex factors affecting DO,the grey relational(GR)degree method is used to screen out the environmental factors most closely related to DO.The consideration of multiple factors makes model fusion more effective.Second,the series of DO,water temperature,salinity,and oxygen saturation are decomposed adaptively into sub-series by means of the empirical wavelet transform(EWT)method.Then,five benchmark models are utilized to forecast the sub-series of EWT decomposition.The ensemble weights of these five sub-forecasting models are calculated by particle swarm optimization and gravitational search algorithm(PSOGSA).Finally,a multi-factor ensemble model for DO is obtained by weighted allocation.The performance of the proposed model is verified by timeseries data collected by the pacific islands ocean observing system(PacIOOS)from the WQB04 station at Hilo.The evaluation indicators involved in the experiment include the Nash–Sutcliffe efficiency(NSE),Kling–Gupta efficiency(KGE),mean absolute percent error(MAPE),standard deviation of error(SDE),and coefficient of determination(R^(2)).Example analysis demonstrates that:①The proposed model can obtain excellent DO forecasting results;②the proposed model is superior to other comparison models;and③the forecasting model can be used to analyze the trend of DO and enable managers to make better management decisions.

The Simulation of Five Tropical Cyclones by Sample Optimization of Ensemble Forecasting Based on the Observed Track and Intensity

The quality of ensemble forecasting is seriously affected by sample quality.In this study,the distributions of ensemble members based on the observed track and intensity of tropical cyclones(TCs)were optimized and their influence on the simulation results was analyzed.Simulated and observed tracks and intensities of TCs were compared and these two indicators were combined and weighted to score the sample.Samples with higher scores were retained and samples with lower scores were eliminated to improve the overall quality of the ensemble forecast.For each sample,the track score and intensity score were added as the final score of the sample with weight proportions of 10 to 0,9 to 1,8 to 2,7 to 3,6 to 4,5 to 5.These were named as“tr”,“91”,“82”,“73”,“64”,and“55”,respectively.The WRF model was used to simulate five tropical cyclones in the northwestern Pacific to test the ability of this scheme to improve the forecast track and intensity of these cyclones.The results show that the sample optimization effectively reduced the track and intensity error,“55”usually had better performance on the short-term intensity prediction,and“tr”had better performance in short-term track prediction.From the overall performance of the track and intensity simulation,“91”was the best and most stable among all sample optimization schemes.These results may provide some guidance for optimizing operational ensemble forecasting of TCs.

Adaptive Error Curve Learning Ensemble Model for Improving Energy Consumption Forecasting

Despite the advancement within the last decades in the field of smart grids,energy consumption forecasting utilizing the metrological features is still challenging.This paper proposes a genetic algorithm-based adaptive error curve learning ensemble(GA-ECLE)model.The proposed technique copes with the stochastic variations of improving energy consumption forecasting using a machine learning-based ensembled approach.A modified ensemble model based on a utilizing error of model as a feature is used to improve the forecast accuracy.This approach combines three models,namely CatBoost(CB),Gradient Boost(GB),and Multilayer Perceptron(MLP).The ensembled CB-GB-MLP model’s inner mechanism consists of generating a meta-data from Gradient Boosting and CatBoost models to compute the final predictions using the Multilayer Perceptron network.A genetic algorithm is used to obtain the optimal features to be used for the model.To prove the proposed model’s effectiveness,we have used a four-phase technique using Jeju island’s real energy consumption data.In the first phase,we have obtained the results by applying the CB-GB-MLP model.In the second phase,we have utilized a GA-ensembled model with optimal features.The third phase is for the comparison of the energy forecasting result with the proposed ECL-based model.The fourth stage is the final stage,where we have applied the GA-ECLE model.We obtained a mean absolute error of 3.05,and a root mean square error of 5.05.Extensive experimental results are provided,demonstrating the superiority of the proposed GA-ECLE model over traditional ensemble models.

Dynamic Analogue Initialization for Ensemble Forecasting

This paper introduces a new approach for the initialization of ensemble numerical forecasting： Dynamic Analogue Initialization （DAI）. DAI assumes that the best model state trajectories for the past provide the initial conditions for the best forecasts in the future. As such, DAI performs the ensemble forecast using the best analogues from a full size ensemble. As a pilot study, the Lorenz63 and Lorenz96 models were used to test DAI＇s effectiveness independently. Results showed that DAI can improve the forecast significantly. Especially in lower-dimensional systems, DAI can reduce the forecast RMSE by ~50% compared to the Monte Carlo forecast （MC）. This improvement is because DAI is able to recognize the direction of the analysis error through the embedding process and therefore selects those good trajectories with reduced initial error. Meanwhile, a potential improvement of DAI is also proposed, and that is to find the optimal range of embedding time based on the error＇s growing speed.

Predictability of Ensemble Forecasting Estimated Using the Kullback–Leibler Divergence in the Lorenz Model

A new method to quantify the predictability limit of ensemble forecasting is presented using the Kullback–Leibler(KL)divergence(also called the relative entropy), which provides a measure of the difference between the probability distributions of ensemble forecasts and local reference(true) states. The KL divergence is applicable to a non-normal distribution of ensemble forecasts, which is a substantial improvement over the previous method using the ensemble spread. An example from the three-variable Lorenz model illustrates the effectiveness of the KL divergence, which can effectively quantify the predictability limit of ensemble forecasting. On this basis, the KL divergence is used to investigate the dependence of the predictability limit of ensemble forecasting on the initial states and the magnitude of initial errors. The local predictability limit of ensemble forecasting varies considerably with the initial states, as well as with the magnitude of initial errors. Further research is needed to examine the real-world applications of the KL divergence in measuring the predictability of ensemble weather forecasts.

Assimilation of Doppler Radar Data with an Ensemble 3DEnVar Approach to Improve Convective Forecasting

An ensemble three-dimensional ensemble-variational(3DEnVar)data assimilation(E3DA)system was developed within the Weather Research and Forecasting model’s 3DVar framework to assimilate radar data to improve convective forecasting.In this system,ensemble perturbations are updated by an ensemble of 3DEnVar and the ensemble forecasts are used to generate the flow-dependent background error covariance.The performance of the E3DA system was first evaluated against one experiment without radar DA and one radar DA experiment with 3DVar,using a severe storm case over southeastern China on 5 June 2009.Results indicated that E3DA improved the quantitative forecast skills of reflectivity and precipitation,as well as their spatial distributions in terms of both intensity and coverage over 3DVar.The root-mean-square error of radial velocity from 3DVar was reduced by E3DA,with stronger low-level wind closer to observation.It was also found that E3DA improved the wind,temperature and water vapor mixing ratio,with the lowest errors at the surface and upper levels.3DVar showed moderate improvements in comparison with forecasts without radar DA.A diagnosis of the analysis revealed that E3DA increased vertical velocity,temperature,and humidity corresponding to the added reflectivity,while 3DVar failed to produce these adjustments,because of the lack of reasonable cross-variable correlations.The performance of E3DA was further verified using two convective cases over southern and southeastern China,and the reflectivity forecast skill was also improved over 3DVar.

Analysis and Forecasting COVID-19 Outbreak in Pakistan Using Decomposition and Ensemble Model

COVID-19 has caused severe health complications and produced a substantial adverse economic impact around the world.Forecasting the trend of COVID-19 infections could help in executing policies to effectively reduce the number of new cases.In this study,we apply the decomposition and ensemble model to forecast COVID-19 confirmed cases,deaths,and recoveries in Pakistan for the upcoming month until the end of July.For the decomposition of data,the Ensemble Empirical Mode Decomposition(EEMD)technique is applied.EEMD decomposes the data into small components,called Intrinsic Mode Functions(IMFs).For individual IMFs modelling,we use the Autoregressive Integrated Moving Average(ARIMA)model.The data used in this study is obtained from the official website of Pakistan that is publicly available and designated for COVID-19 outbreak with daily updates.Our analyses reveal that the number of recoveries,new cases,and deaths are increasing in Pakistan exponentially.Based on the selected EEMD-ARIMA model,the new confirmed cases are expected to rise from 213,470 to 311,454 by 31 July 2020,which is an increase of almost 1.46 times with a 95%prediction interval of 246,529 to 376,379.The 95%prediction interval for recovery is 162,414 to 224,579,with an increase of almost two times in total from 100802 to 193495 by 31 July 2020.On the other hand,the deaths are expected to increase from 4395 to 6751,which is almost 1.54 times,with a 95%prediction interval of 5617 to 7885.Thus,the COVID-19 forecasting results of Pakistan are alarming for the next month until 31 July 2020.They also confirm that the EEMD-ARIMA model is useful for the short-term forecasting of COVID-19,and that it is capable of keeping track of the real COVID-19 data in nearly all scenarios.The decomposition and ensemble strategy can be useful to help decision-makers in developing short-term strategies about the current number of disease occurrences until an appropriate vaccine is developed.

Optimization Ensemble Weights Model for Wind Forecasting System

Effective technology for wind direction forecasting can be realized using the recent advances in machine learning.Consequently,the stability and safety of power systems are expected to be significantly improved.However,the unstable and unpredictable qualities of the wind predict the wind direction a challenging problem.This paper proposes a practical forecasting approach based on the weighted ensemble of machine learning models.This weighted ensemble is optimized using a whale optimization algorithm guided by particle swarm optimization(PSO-Guided WOA).The proposed optimized weighted ensemble predicts the wind direction given a set of input features.The conducted experiments employed the wind power forecasting dataset,freely available on Kaggle and developed to predict the regular power generation at seven wind farms over forty-eight hours.The recorded results of the conducted experiments emphasize the effectiveness of the proposed ensemble in achieving accurate predictions of the wind direction.In addition,a comparison is established between the proposed optimized ensemble and other competing optimized ensembles to prove its superiority.Moreover,statistical analysis using one-way analysis of variance(ANOVA)and Wilcoxon’s rank-sum are provided based on the recorded results to confirm the excellent accuracy achieved by the proposed optimized weighted ensemble.

THE ENSEMBLE FORECASTING OF TROPICAL CYCLONE MOTION I:USING A PRIMITIVE EQUATION BAROTROPIC MODEL

Ensemble forecasting of tropical cyclone (TC) motion was studied using a primitive equation barotropic model by perturbing initial position and structure for 1979 1993 TC. The results show that TC initial position perturbation affects its track, but the ensemble mean is close to control forecast. Experiments was also performed by perturbing TC initial parameters which were used to generate TC initial field, and more improvement can be obtained by taking ensemble mean of selective member than selecting members randomly. The skill of 60 % 70 % of all cases is improved in selective ensemble mean. When the ambient steering current is weak, more improvement can be obtained over the control forecast.

SVR-Boosting ensemble model for electricity price forecasting in electric power market

A revised support vector regression (SVR) ensemble model based on boosting algorithm (SVR-Boosting) is presented in this paper for electricity price forecasting in electric power market. In the light of characteristics of electricity price sequence, a new triangular-shaped 为oss function is constructed in the training of the forecasting model to inhibit the learning from abnormal data in electricity price sequence. The results from actual data indicate that, compared with the single support vector regression model, the proposed SVR-Boosting ensemble model is able to enhance the stability of the model output remarkably, acquire higher predicting accuracy, and possess comparatively satisfactory generalization capability.

Bootstrapped Multi-Model Neural-Network Super-Ensembles for Wind Speed and Power Forecasting

The bootstrap resampling method is applied to an ensemble artificial neural network (ANN) approach (which combines machine learning with physical data obtained from a numerical weather prediction model) to provide a multi-ANN model super-ensemble for application to multi-step-ahead forecasting of wind speed and of the associated power generated from a wind turbine. A statistical combination of the individual forecasts from the various ANNs of the super-ensemble is used to construct the best deterministic forecast, as well as the prediction uncertainty interval associated with this forecast. The bootstrapped neural-network methodology is validated using measured wind speed and power data acquired from a wind turbine in an operational wind farm located in northern China.