Non-crossing Quantile Regression Neural Network as a Calibration Tool for Ensemble Weather Forecasts

Despite the maturity of ensemble numerical weather prediction(NWP),the resulting forecasts are still,more often than not,under-dispersed.As such,forecast calibration tools have become popular.Among those tools,quantile regression(QR)is highly competitive in terms of both flexibility and predictive performance.Nevertheless,a long-standing problem of QR is quantile crossing,which greatly limits the interpretability of QR-calibrated forecasts.On this point,this study proposes a non-crossing quantile regression neural network(NCQRNN),for calibrating ensemble NWP forecasts into a set of reliable quantile forecasts without crossing.The overarching design principle of NCQRNN is to add on top of the conventional QRNN structure another hidden layer,which imposes a non-decreasing mapping between the combined output from nodes of the last hidden layer to the nodes of the output layer,through a triangular weight matrix with positive entries.The empirical part of the work considers a solar irradiance case study,in which four years of ensemble irradiance forecasts at seven locations,issued by the European Centre for Medium-Range Weather Forecasts,are calibrated via NCQRNN,as well as via an eclectic mix of benchmarking models,ranging from the naïve climatology to the state-of-the-art deep-learning and other non-crossing models.Formal and stringent forecast verification suggests that the forecasts post-processed via NCQRNN attain the maximum sharpness subject to calibration,amongst all competitors.Furthermore,the proposed conception to resolve quantile crossing is remarkably simple yet general,and thus has broad applicability as it can be integrated with many shallow-and deep-learning-based neural networks.

Scientific Advances and Weather Services of the China Meteorological Administration’s National Forecasting Systems during the Beijing 2022 Winter Olympics

Since the Beijing 2022 Winter Olympics was the first Winter Olympics in history held in continental winter monsoon climate conditions across complex terrain areas,there is a deficiency of relevant research,operational techniques,and experience.This made providing meteorological services for this event particularly challenging.The China Meteorological Administration(CMA)Earth System Modeling and Prediction Centre,achieved breakthroughs in research on short-and medium-term deterministic and ensemble numerical predictions.Several key technologies crucial for precise winter weather services during the Winter Olympics were developed.A comprehensive framework,known as the Operational System for High-Precision Weather Forecasting for the Winter Olympics,was established.Some of these advancements represent the highest level of capabilities currently available in China.The meteorological service provided to the Beijing 2022 Games also exceeded previous Winter Olympic Games in both variety and quality.This included achievements such as the“100-meter level,minute level”downscaled spatiotemporal resolution and forecasts spanning 1 to 15 days.Around 30 new technologies and over 60 kinds of products that align with the requirements of the Winter Olympics Organizing Committee were developed,and many of these techniques have since been integrated into the CMA’s operational national forecasting systems.These accomplishments were facilitated by a dedicated weather forecasting and research initiative,in conjunction with the preexisting real-time operational forecasting systems of the CMA.This program represents one of the five subprograms of the WMO’s high-impact weather forecasting demonstration project(SMART2022),and continues to play an important role in their Regional Association(RA)II Research Development Project(Hangzhou RDP).Therefore,the research accomplishments and meteorological service experiences from this program will be carried forward into forthcoming highimpact weather forecasting activities.This article provides an overview and assessment of this program and the operational national forecasting systems.

Automatic Generation of Artificial Space Weather Forecast Product Based on Sequence-to-sequence Model

Both analyzing a large amount of space weather observed data and alleviating personal experience bias are significant challenges in generating artificial space weather forecast products.With the use of natural language generation methods based on the sequence-to-sequence model,space weather forecast texts can be automatically generated.To conduct our generation tasks at a fine-grained level,a taxonomy of space weather phenomena based on descriptions is presented.Then,our MDH(Multi-Domain Hybrid)model is proposed for generating space weather summaries in two stages.This model is composed of three sequence-to-sequence-based deep neural network sub-models(one Bidirectional Auto-Regressive Transformers pre-trained model and two Transformer models).Then,to evaluate how well MDH performs,quality evaluation metrics based on two prevalent automatic metrics and our innovative human metric are presented.The comprehensive scores of the three summaries generating tasks on testing datasets are 70.87,93.50,and 92.69,respectively.The results suggest that MDH can generate space weather summaries with high accuracy and coherence,as well as suitable length,which can assist forecasters in generating high-quality space weather forecast products,despite the data being starved.

Weather-Driven Solar Power Forecasting Using D-Informer:Enhancing Predictions with Climate Variables

Precise forecasting of solar power is crucial for the development of sustainable energy systems.Contemporary forecasting approaches often fail to adequately consider the crucial role of weather factors in photovoltaic(PV)power generation and encounter issues such as gradient explosion or disappearance when dealing with extensive time-series data.To overcome these challenges,this research presents a cutting-edge,multi-stage forecasting method called D-Informer.This method skillfully merges the differential transformation algorithm with the Informer model,leveraging a detailed array of meteorological variables and historical PV power generation records.The D-Informer model exhibits remarkable superiority over competing models across multiple performance metrics,achieving on average a 67.64%reduction in mean squared error(MSE),a 49.58%decrease in mean absolute error(MAE),and a 43.43%reduction in root mean square error(RMSE).Moreover,it attained an R2 value as high as 0.9917 during the winter season,highlighting its precision and dependability.This significant advancement can be primarily attributed to the incorporation of a multi-head self-attention mechanism,which greatly enhances the model’s ability to identify complex interactions among diverse input variables,and the inclusion of weather variables,enriching the model’s input data and strengthening its predictive accuracy in time series analysis.Additionally,the experimental results confirm the effectiveness of the proposed approach.

Improvements in Weather Forecasting Technique Using Cognitive Internet of Things

Forecasting the weather is a challenging task for human beings because of the unpredictable nature of the climate.However,effective forecasting is vital for the general growth of a country due to the significance of weather forecasting in science and technology.The primary motivation behind this work is to achieve a higher level of forecasting accuracy to avoid any damage.Currently,most weather forecasting work is based on initially observed numerical weather data that cannot fully cover the changing essence of the atmosphere.In this work,sensors are used to collect real-time data for a particular location to capture the varying nature of the atmosphere.Our solution can give the anticipated results with the least amount of human engagement by combining human intelligence and machine learning with the help of the cognitive Internet of Things.The Authors identified weatherrelated parameters such as temperature,humidity,wind speed,and rainfall and then applied cognitive data collection methods to train and validate their findings.In addition,the Authors have examined the efficacy of various machine learning algorithms by using them on both data sets i.e.,pre-recorded metrological data sets and live sensor data sets collected from multiple locations.The Authors noticed that the results were superior on the sensor data.The Authors developed ensemble learning model using stacked method that achieved 99.25%accuracy,99%recall,99%precision,and 99%F1-score for Sensor data.It also achieved 85%accuracy,86%recall,85%precision,and 86%F1 score for Australian rainfall data.

Real-Time Crop Prediction Based on Soil Fertility and Weather Forecast Using IoT and a Machine Learning Algorithm

The aim of this article is to assist farmers in making better crop selection decisions based on soil fertility and weather forecast through the use of IoT and AI (smart farming). To accomplish this, a prototype was developed capable of predicting the best suitable crop for a specific plot of land based on soil fertility and making recommendations based on weather forecast. Random Forest machine learning algorithm was used and trained with Jupyter in the Anaconda framework to achieve an accuracy of about 99%. Based on this process, IoT with the Message Queuing Telemetry Transport (MQTT) protocol, a machine learning algorithm, based on Random Forest, and weather forecast API for crop prediction and recommendations were used. The prototype accepts nitrogen, phosphorus, potassium, humidity, temperature and pH as input parameters from the IoT sensors, as well as the weather API for data forecasting. The approach was tested in a suburban area of Yaounde (Cameroon). Taking into account future meteorological parameters (rainfall, wind and temperature) in this project produced better recommendations and therefore better crop selection. All necessary results can be accessed from anywhere and at any time using the IoT system via a web browser.

Forecasting solar still performance from conventional weather data variation by machine learning method

Solar stills are considered an effective method to solve the scarcity of drinkable water.However,it is still missing a way to forecast its production.Herein,it is proposed that a convenient forecasting model which just needs to input the conventional weather forecasting data.The model is established by using machine learning methods of random forest and optimized by Bayesian algorithm.The required data to train the model are obtained from daily measurements lasting9 months.To validate the accuracy model,the determination coefficients of two types of solar stills are calculated as 0.935and 0.929,respectively,which are much higher than the value of both multiple linear regression(0.767)and the traditional models(0.829 and 0.847).Moreover,by applying the model,we predicted the freshwater production of four cities in China.The predicted production is approved to be reliable by a high value of correlation(0.868)between the predicted production and the solar insolation.With the help of the forecasting model,it would greatly promote the global application of solar stills.

Clothing Sales Forecast Considering Weather Information: An Empirical Study in Brick-and-Mortar Stores by Machine-Learning

Reliable sales forecasts are important to the garment industry. In recent years, the global climate is warming, the weather changes frequently, and clothing sales are affected by weather fluctuations. The purpose of this study is to investigate whether weather data can improve the accuracy of product sales and to establish a corresponding clothing sales forecasting model. This model uses the basic attributes of clothing product data, historical sales data, and weather data. It is based on a random forest, XGB, and GBDT adopting a stacking strategy. We found that weather information is not useful for basic clothing sales forecasts, but it did improve the accuracy of seasonal clothing sales forecasts. The MSE of the dresses, down jackets, and shirts are reduced by 86.03%, 80.14%, and 41.49% on average. In addition, we found that the stacking strategy model outperformed the voting strategy model, with an average MSE reduction of 49.28%. Clothing managers can use this model to forecast their sales when they make sales plans based on weather information.

A Deep Learning Approach for Forecasting Thunderstorm Gusts in the Beijing–Tianjin–Hebei Region

Thunderstorm gusts are a common form of severe convective weather in the warm season in North China,and it is of great importance to correctly forecast them.At present,the forecasting of thunderstorm gusts is mainly based on traditional subjective methods,which fails to achieve high-resolution and high-frequency gridded forecasts based on multiple observation sources.In this paper,we propose a deep learning method called Thunderstorm Gusts TransU-net(TGTransUnet)to forecast thunderstorm gusts in North China based on multi-source gridded product data from the Institute of Urban Meteorology(IUM)with a lead time of 1 to 6 h.To determine the specific range of thunderstorm gusts,we combine three meteorological variables:radar reflectivity factor,lightning location,and 1-h maximum instantaneous wind speed from automatic weather stations(AWSs),and obtain a reasonable ground truth of thunderstorm gusts.Then,we transform the forecasting problem into an image-to-image problem in deep learning under the TG-TransUnet architecture,which is based on convolutional neural networks and a transformer.The analysis and forecast data of the enriched multi-source gridded comprehensive forecasting system for the period 2021–23 are then used as training,validation,and testing datasets.Finally,the performance of TG-TransUnet is compared with other methods.The results show that TG-TransUnet has the best prediction results at 1–6 h.The IUM is currently using this model to support the forecasting of thunderstorm gusts in North China.

Impact of mica on geotechnical behavior of weathered granitic soil using macro and micro investigations

The micaceous weathered granitic soil(WGS)is frequently encountered in civil engineering worldwide,unfortunately little information is available regarding how mica affects the physico-mechanical behaviors of WGS.This study prepares reconstituted WGS with different mica contents by removing natural mica in theWGS,and then mixes it with commercial mica powders.The geotechnical behavior as well as the microstructures of the mixtures are characterized.The addition of mica enables the physical indices of WGS to be specific combinations of coarser gradation and high permeability but high Atterberg limits.However,high mica content in WGS was found to be associated with undesirable mechanical properties,including increased compressibility,disintegration,and swelling potential,as well as poor compactability and low effective frictional angle.Microstructural analysis indicates that the influence of mica on the responses of mixtures originates from the intrinsic nature of mica as well as the particle packing being formed withinWGS.Mica exists in the mixture as stacks of plates that form a spongy structure with high compressibility and swelling potential.Pores among the plates give the soil high water retention and high Atterberg limits.Large pores are also generated by soil particles with bridging packing,which enhances the permeability and water-soil interactions upon immersion.This study provides a microlevel understanding of how mica dominates the behavior of WGS and provides new insights into the effective stabilization and improvement of micaceous soils.

Analysis of Spatial and Temporal Variation and Forecast Model of Sandstorm Weather in Ulanqab City

Based on the data of sandstorm at 11 stations in Ulanqab City from 1990 to 2021,the spatial and temporal variation characteristics of sand-storm weather were analyzed firstly,and then the conceptual models of cold front and Mongolian cyclone sandstorm were obtained by analyzing sandstorm cases.Finally,the forecast points of the two types of sandstorm weather were given to provide some scientific basis and reference for the prediction of local sandstorm weather in the future.

Quantum Atmospheric Biophysics: A Comparison of Four Weather Stations in India on Average Monthly Temperatures Since 1892 and Forecasts to 2150

The identification method revealed asymmetric wavelets of dynamics, as fractal quanta of the behavior of the surface air layer at a height of 2 m, according to the average monthly temperature at four weather stations in India (Srinagar, Jolhpur, New Delhi and Guvahati). For Srinagar station, the maximum for all years is observed in July, for Jolhpur and New Delhi stations it shifts to June, and for Guvahati it shifts to August. With a high correlation coefficient of 0.9659, 0.8640 and 0.8687, a three-factor model of the form was obtained. The altitude, longitude and latitude of the station are given sequentially. The hottest month for Srinagar over a period of 130 years is in July. At the same time, the temperature increased from 23.4 °C to 24.2 °C (by 3.31%). A noticeable decrease in the intensity of heat flows in June occurred at Jolhpur (over 125 years, a decrease from 36.2 °C to 33.3 °C, or by 8.71%) and New Delhi (over 90 years, a decrease from 35.1 °C to 32.4 °C, or by 7.69%). For almost 120 years, Guvahati has experienced complex climate changes: In 1902, the hottest month was July, but in 2021 it has shifted to August. The increase in temperature at various stations is considered. At Srinagar station in 2021, compared to 1892, temperatures increased in June, September and October. Guvahati has a 120-year increase in December, January, March and April. Temperatures have risen in February, March and April at Jolhpur in 125 years, but have risen in February and March at New Delhi Station in 90 years. Despite the presence of tropical evergreen forests, the area around Guvahati Station is expected to experience strong warming.

Seasonal Characteristics of Forecasting Uncertainties in Surface PM_(2.5)Concentration Associated with Forecast Lead Time over the Beijing-Tianjin-Hebei Region

Forecasting uncertainties among meteorological fields have long been recognized as the main limitation on the accuracy and predictability of air quality forecasts.However,the particular impact of meteorological forecasting uncertainties on air quality forecasts specific to different seasons is still not well known.In this study,a series of forecasts with different forecast lead times for January,April,July,and October of 2018 are conducted over the Beijing-Tianjin-Hebei(BTH)region and the impacts of meteorological forecasting uncertainties on surface PM_(2.5)concentration forecasts with each lead time are investigated.With increased lead time,the forecasted PM_(2.5)concentrations significantly change and demonstrate obvious seasonal variations.In general,the forecasting uncertainties in monthly mean surface PM_(2.5)concentrations in the BTH region due to lead time are the largest(80%)in spring,followed by autumn(~50%),summer(~40%),and winter(20%).In winter,the forecasting uncertainties in total surface PM_(2.5)mass due to lead time are mainly due to the uncertainties in PBL heights and hence the PBL mixing of anthropogenic primary particles.In spring,the forecasting uncertainties are mainly from the impacts of lead time on lower-tropospheric northwesterly winds,thereby further enhancing the condensation production of anthropogenic secondary particles by the long-range transport of natural dust.In summer,the forecasting uncertainties result mainly from the decrease in dry and wet deposition rates,which are associated with the reduction of near-surface wind speed and precipitation rate.In autumn,the forecasting uncertainties arise mainly from the change in the transport of remote natural dust and anthropogenic particles,which is associated with changes in the large-scale circulation.

Evaluation of a Wireless Solar Powered Personal Weather Station

We are evaluating dryland cotton production in Martin County, Texas, measuring cotton lint yield per unit of rainfall. Our goal is to collect rainfall data per 250 - 400 ha. Upon selection of a rainfall gauge, we realized that the cost of using, for example, a tipping bucket-type rain gauge would be too expensive and thus searched for an alternative method. We selected an all-in-one commercially available weather station;hereafter, referred to as a Personal Weather Station (PWS) that is both wireless and solar powered. Our objective was to evaluate average measurements of rainfall obtained with the PWS and to compare these to measurements obtained with an automatic weather station (AWS). For this purpose, we installed four PWS deployed within 20 m of the Plant Stress and Water Conservation Meteorological Tower that was used as our AWS, located at USDA-ARS Cropping Systems Research Laboratory, Lubbock, TX. In addition, we measured and compared hourly average values of short-wave irradiance (Rg), air temperature (Tair) and relative humidity (RH), and wind speed (WS), and calculated values of dewpoint temperature (Tdew). This comparison was done over a 242-day period (1 October 2022-31 May 2023) and results indicated that there was no statistical difference in measurements of rainfall between the PWS and AWS. Hourly average values of Rg measured with the PWS and AWS agreed on clear days, but PWS measurements were higher on cloudy days. There was no statistical difference between PWS and AWS hourly average measurements of Tair, RH, and calculated Tdew. Hourly average measurements of Rg and WS were more variable. We concluded that the PWS we selected will provide adequate values of rainfall and other weather variables to meet our goal of evaluating dryland cotton lint yield per unit rainfall.

Forecast Method of Ozone Concentration in Yulin City Based on Meteorological Conditions

Based on the monitoring data of ozone(O 3)concentration,conventional meteorological data and reanalysis products in Yulin City from 2018 to 2019,the weather situation of O 3 pollution was classified through case analysis and mathematical statistics.At 500 hPa,the weather situation was divided into continental high pressure type,subtropical high type and mixed type.At 850 hPa,it was divided into southwest air flow type,east air flow type and south air flow type.The correlation between meteorological element and O 3 concentration were analyzed,and factors with good correlation such as temperature,air pressure and wind speed were selected to establish regression equations.The fitting effect was good,and O 3 concentration could be objectively predicted.

Better use of experience from other reservoirs for accurate production forecasting by learn-to-learn method

To assess whether a development strategy will be profitable enough,production forecasting is a crucial and difficult step in the process.The development history of other reservoirs in the same class tends to be studied to make predictions accurate.However,the permeability field,well patterns,and development regime must all be similar for two reservoirs to be considered in the same class.This results in very few available experiences from other reservoirs even though there is a lot of historical information on numerous reservoirs because it is difficult to find such similar reservoirs.This paper proposes a learn-to-learn method,which can better utilize a vast amount of historical data from various reservoirs.Intuitively,the proposed method first learns how to learn samples before directly learning rules in samples.Technically,by utilizing gradients from networks with independent parameters and copied structure in each class of reservoirs,the proposed network obtains the optimal shared initial parameters which are regarded as transferable information across different classes.Based on that,the network is able to predict future production indices for the target reservoir by only training with very limited samples collected from reservoirs in the same class.Two cases further demonstrate its superiority in accuracy to other widely-used network methods.

Generalized load graphical forecasting method based on modal decomposition

In a“low-carbon”context,the power load is affected by the coupling of multiple factors,which gradually evolves from the traditional“pure load”to the generalized load with the dual characteristics of“load+power supply.”Traditional time-series forecasting methods are no longer suitable owing to the complexity and uncertainty associated with generalized loads.From the perspective of image processing,this study proposes a graphical short-term prediction method for generalized loads based on modal decomposition.First,the datasets are normalized and feature-filtered by comparing the results of Xtreme gradient boosting,gradient boosted decision tree,and random forest algorithms.Subsequently,the generalized load data are decomposed into three sets of modalities by modal decomposition,and red,green,and blue(RGB)images are generated using them as the pixel values of the R,G,and B channels.The generated images are diversified,and an optimized DenseNet neural network was used for training and prediction.Finally,the base load,wind power,and photovoltaic power generation data are selected,and the characteristic curves of the generalized load scenarios under different permeabilities of wind power and photovoltaic power generation are obtained using the density-based spatial clustering of applications with noise algorithm.Based on the proposed graphical forecasting method,the feasibility of the generalized load graphical forecasting method is verified by comparing it with the traditional time-series forecasting method.

Comparison among the UECM Model, and the Composite Model in Forecasting Malaysian Imports

For more than a century, forecasting models have been crucial in a variety of fields. Models can offer the most accurate forecasting outcomes if error terms are normally distributed. Finding a good statistical model for time series predicting imports in Malaysia is the main target of this study. The decision made during this study mostly addresses the unrestricted error correction model (UECM), and composite model (Combined regression—ARIMA). The imports of Malaysia from the first quarter of 1991 to the third quarter of 2022 are employed in this study’s quarterly time series data. The forecasting outcomes of the current study demonstrated that the composite model offered more probabilistic data, which improved forecasting the volume of Malaysia’s imports. The composite model, and the UECM model in this study are linear models based on responses to Malaysia’s imports. Future studies might compare the performance of linear and nonlinear models in forecasting.

Enhancing Deep Learning Soil Moisture Forecasting Models by Integrating Physics-based Models

Accurate soil moisture(SM)prediction is critical for understanding hydrological processes.Physics-based(PB)models exhibit large uncertainties in SM predictions arising from uncertain parameterizations and insufficient representation of land-surface processes.In addition to PB models,deep learning(DL)models have been widely used in SM predictions recently.However,few pure DL models have notably high success rates due to lacking physical information.Thus,we developed hybrid models to effectively integrate the outputs of PB models into DL models to improve SM predictions.To this end,we first developed a hybrid model based on the attention mechanism to take advantage of PB models at each forecast time scale(attention model).We further built an ensemble model that combined the advantages of different hybrid schemes(ensemble model).We utilized SM forecasts from the Global Forecast System to enhance the convolutional long short-term memory(ConvLSTM)model for 1–16 days of SM predictions.The performances of the proposed hybrid models were investigated and compared with two existing hybrid models.The results showed that the attention model could leverage benefits of PB models and achieved the best predictability of drought events among the different hybrid models.Moreover,the ensemble model performed best among all hybrid models at all forecast time scales and different soil conditions.It is highlighted that the ensemble model outperformed the pure DL model over 79.5%of in situ stations for 16-day predictions.These findings suggest that our proposed hybrid models can adequately exploit the benefits of PB model outputs to aid DL models in making SM predictions.

2023: Weather and Climate Extremes Hitting the Globe with Emerging Features

Globally,2023 was the warmest observed year on record since at least 1850 and,according to proxy evidence,possibly of the past 100000 years.As in recent years,the record warmth has again been accompanied with yet more extreme weather and climate events throughout the world.Here,we provide an overview of those of 2023,with details and key background causes to help build upon our understanding of the roles of internal climate variability and anthropogenic climate change.We also highlight emerging features associated with some of these extreme events.Hot extremes are occurring earlier in the year,and increasingly simultaneously in differing parts of the world(e.g.,the concurrent hot extremes in the Northern Hemisphere in July 2023).Intense cyclones are exacerbating precipitation extremes(e.g.,the North China flooding in July and the Libya flooding in September).Droughts in some regions(e.g.,California and the Horn of Africa)have transitioned into flood conditions.Climate extremes also show increasing interactions with ecosystems via wildfires(e.g.,those in Hawaii in August and in Canada from spring to autumn 2023)and sandstorms(e.g.,those in Mongolia in April 2023).Finally,we also consider the challenges to research that these emerging characteristics present for the strategy and practice of adaptation.