TianXing:A Linear Complexity Transformer Model with Explicit Attention Decay for Global Weather Forecasting

In this paper,we introduce TianXing,a transformer-based data-driven model designed with physical augmentation for skillful and efficient global weather forecasting.Previous data-driven transformer models such as Pangu-Weather,FengWu,and FuXi have emerged as promising alternatives for numerical weather prediction in weather forecasting.However,these models have been characterized by their substantial computational resource consumption during training and limited incorporation of explicit physical guidance in their modeling frameworks.In contrast,TianXing applies a linear complexity mechanism that ensures proportional scalability with input data size while significantly diminishing GPU resource demands,with only a marginal compromise in accuracy.Furthermore,TianXing proposes an explicit attention decay mechanism in the linear attention derived from physical insights to enhance its forecasting skill.The mechanism can reweight attention based on Earth's spherical distances and learned sparse multivariate coupling relationships,promptingTianXing to prioritize dynamically relevant neighboring features.Finally,to enhance its performance in mediumrange forecasting,TianXing employs a stacked autoregressive forecast algorithm.Validation of the model's architecture is conducted using ERA5 reanalysis data at a 5.625°latitude-longitude resolution,while a high-resolution dataset at 0.25°is utilized for training the actual forecasting model.Notably,the TianXing exhibits excellent performance,particularly in the Z500(geopotential height)and T850(temperature)fields,surpassing previous data-driven models and operational fullresolution models such as NCEP GFS and ECMWF IFS,as evidenced by latitude-weighted RMSE and ACC metrics.Moreover,the TianXing has demonstrated remarkable capabilities in predicting extreme weather events,such as typhoons.

Meteorological observations and weather forecasting services of the CHINARE

By 2018, China had conducted 34 scientific explorations in Antarctica spearheaded by the Chinese National Antarctic Research Expedition(CHINARE). Since the first CHINARE over 30 years ago, considerable work has been undertaken to promote the development of techniques for the observation of surface and upper-air meteorological elements, and satellite image and data reception systems at Chinese Antarctic stations and onboard Chinese icebreakers have played critical roles in this endeavor. The upgrade of in situ and remote sensing measurement methods and the improvement of weather forecasting skill have enabled forecasters to achieve reliable on-site weather forecasting for the CHINARE. Nowadays, the routing of icebreakers, navigation of aircraft, and activities at Chinese Antarctic stations all benefit from the accurate weather forecasting service. In this paper, a review of the conventional meteorological measurement and operational weather forecasting services of the CHINARE is presented.

Machine Learning of Weather Forecasting Rules from Large Meteorological Data Bases

Discovery of useful forecasting rules from observational weather data is an outstanding interesting topic.The traditional methods of acquiring forecasting knowledge are manual analysis and investigation performed by human scientists.This paper presents the experimental results of an automatic machine learning system which derives forecasting rules from real observational data.We tested the system on the two large real data sets from the areas of centra! China and Victoria of Australia.The experimental results show that the forecasting rules discovered by the system are very competitive to human experts.The forecasting accuracy rates are 86.4% and 78% of the two data sets respectively

The Need of Incorporating Indigenous Knowledge Systems into Modern Weather Forecasting Methods

The study was aimed to examine the need of incorporating traditional weather forecasting renowned indigenous knowledge system (IKS) into modern weather forecasting methods to be used for planning farming activities. In addition, not only gap that is not infused by current weather forecasting system with their advanced studies to understand why it is incorporated into existing technical frameworks was regarded, but also the limitation of advanced weather forecasting approach and strength to be elicited by indigenous knowledge system are crucial. Perspicuously, forms and onsite interrogates have been conducted to assess people’s beliefs, understanding, and attitudes on the indigenous knowledge system significance on weather forecasting. Therefore, atmospheric and biological conditions, astronomic, as well as relief characteristics were used to predict the weather over short and long periods. Usually, in assessing weather conditions, the conduct of animals and insects were listed as essential. Obviously, in order to predict weather particularly from rain within about short period of time, astronomical characteristics were used. Commonly, there are few peers who know conventional weather prediction approaches. This lowers the reliability of conventional weather prediction. The findings revealed some variables that impact meteorological inaccuracy by scientific methods and help to recognize and evaluate the gap that current meteorological technologies do not achieve and new particulars anticipated to be filled with conventional methods to attain accurate weather prediction. Additionally, the study indicated that both modern and conventional processes have certain positive and limitations, which means that they can be coupled to generate more accurate weather prediction reports for end users.

How much Numerical Products Affect Weather Forecasting

The paper shows how much improvement can be achieved in weather forecasting by using NWP products. And for weather element forecasts, the types and number of NWP products highly impact on the quality of MOS forecasts and other utilities.

An Implementation of Full Cycle Strategy Using Dynamic Blending for Rapid Refresh Short-range Weather Forecasting in China

The partial cycle(PC)strategy has been used in many rapid refresh cycle systems(RRC)for regional short-range weather forecasting.Since the strategy periodically reinitializes the regional model(RM)from the global model(GM)forecasts to correct the large-scale drift,it has replaced the traditional full cycle(FC)strategy in many RRC systems.However,the extra spin-up in the PC strategy increases the computer burden on RRC and generates discontinuous smallscale systems among cycles.This study returns to the FC strategy but with initial fields generated by dynamic blending(DB)and data assimilation(DA).The DB ingests the time-varied large-scale information from the GM to the RM to generate less-biased background fields.Then the DA is performed.We applied the new FC strategy in a series of 7-day batch forecasts with the 3-hour cycle in July 2018,and February,April,and October 2019 over China using a Weather Research and Forecast(WRF)model-based RRC.A comparison shows that the new FC strategy results in less model bias than the PC strategy in most state variables and improves the forecast skills for moderate and light precipitation.The new FC strategy also allows the model to reach a balanced state earlier and gives favorable forecast continuity between adjacent cycles.Hence,this new FC strategy has potential to be applied in RRC forecast systems to replace the currently used PC strategy.

IMPACT OF VERTICAL RESOLUTION, MODEL TOP AND DATA ASSIMILATION ON WEATHER FORECASTING——A CASE STUDY

The impacts of stratospheric initial conditions and vertical resolution on the stratosphere by raising the model top,refining the vertical resolution,and the assimilation of operationally available observations,including conventional and satellite observations,on continental U.S.winter short-range weather forecasting,were investigated in this study.The initial and predicted wind and temperature profiles were analyzed against conventional observations.Generally,the initial wind and temperature bias profiles were better adjusted when a higher model top and refined vertical resolution were used.Negative impacts were also observed in both the initial wind and temperature profiles,over the lower troposphere.Different from the results by only raising the model top,the assimilation of operationally available observations led to significant improvements in both the troposphere and stratosphere initial conditions when a higher top was used.Predictions made with the adjusted stratospheric initial conditions and refined vertical resolutions showed generally better forecasting skill.The major improvements caused by raising the model top with refined vertical resolution,as well as those caused by data assimilation,were in both cases located in the tropopause and lower stratosphere.Negative impacts were also observed in the predicted near surface wind and lower-tropospheric temperature.These negative impacts were related to the uncertainties caused by more stratospheric information,as well as to some physical processes.A case study shows that when we raise the model top,put more vertical layers in stratosphere and apply data assimilation,the precipitation scores can be slightly improved.However,more analysis is needed due to uncertainties brought by data assimilation.

Improvements in Weather Forecasting Technique Using Cognitive Internet of Things

Forecasting the weather is a challenging task for human beings because of the unpredictable nature of the climate.However,effective forecasting is vital for the general growth of a country due to the significance of weather forecasting in science and technology.The primary motivation behind this work is to achieve a higher level of forecasting accuracy to avoid any damage.Currently,most weather forecasting work is based on initially observed numerical weather data that cannot fully cover the changing essence of the atmosphere.In this work,sensors are used to collect real-time data for a particular location to capture the varying nature of the atmosphere.Our solution can give the anticipated results with the least amount of human engagement by combining human intelligence and machine learning with the help of the cognitive Internet of Things.The Authors identified weatherrelated parameters such as temperature,humidity,wind speed,and rainfall and then applied cognitive data collection methods to train and validate their findings.In addition,the Authors have examined the efficacy of various machine learning algorithms by using them on both data sets i.e.,pre-recorded metrological data sets and live sensor data sets collected from multiple locations.The Authors noticed that the results were superior on the sensor data.The Authors developed ensemble learning model using stacked method that achieved 99.25%accuracy,99%recall,99%precision,and 99%F1-score for Sensor data.It also achieved 85%accuracy,86%recall,85%precision,and 86%F1 score for Australian rainfall data.

A Deep Learning Approach for Forecasting Thunderstorm Gusts in the Beijing–Tianjin–Hebei Region

Thunderstorm gusts are a common form of severe convective weather in the warm season in North China,and it is of great importance to correctly forecast them.At present,the forecasting of thunderstorm gusts is mainly based on traditional subjective methods,which fails to achieve high-resolution and high-frequency gridded forecasts based on multiple observation sources.In this paper,we propose a deep learning method called Thunderstorm Gusts TransU-net(TGTransUnet)to forecast thunderstorm gusts in North China based on multi-source gridded product data from the Institute of Urban Meteorology(IUM)with a lead time of 1 to 6 h.To determine the specific range of thunderstorm gusts,we combine three meteorological variables:radar reflectivity factor,lightning location,and 1-h maximum instantaneous wind speed from automatic weather stations(AWSs),and obtain a reasonable ground truth of thunderstorm gusts.Then,we transform the forecasting problem into an image-to-image problem in deep learning under the TG-TransUnet architecture,which is based on convolutional neural networks and a transformer.The analysis and forecast data of the enriched multi-source gridded comprehensive forecasting system for the period 2021–23 are then used as training,validation,and testing datasets.Finally,the performance of TG-TransUnet is compared with other methods.The results show that TG-TransUnet has the best prediction results at 1–6 h.The IUM is currently using this model to support the forecasting of thunderstorm gusts in North China.

Non-crossing Quantile Regression Neural Network as a Calibration Tool for Ensemble Weather Forecasts

Despite the maturity of ensemble numerical weather prediction(NWP),the resulting forecasts are still,more often than not,under-dispersed.As such,forecast calibration tools have become popular.Among those tools,quantile regression(QR)is highly competitive in terms of both flexibility and predictive performance.Nevertheless,a long-standing problem of QR is quantile crossing,which greatly limits the interpretability of QR-calibrated forecasts.On this point,this study proposes a non-crossing quantile regression neural network(NCQRNN),for calibrating ensemble NWP forecasts into a set of reliable quantile forecasts without crossing.The overarching design principle of NCQRNN is to add on top of the conventional QRNN structure another hidden layer,which imposes a non-decreasing mapping between the combined output from nodes of the last hidden layer to the nodes of the output layer,through a triangular weight matrix with positive entries.The empirical part of the work considers a solar irradiance case study,in which four years of ensemble irradiance forecasts at seven locations,issued by the European Centre for Medium-Range Weather Forecasts,are calibrated via NCQRNN,as well as via an eclectic mix of benchmarking models,ranging from the naïve climatology to the state-of-the-art deep-learning and other non-crossing models.Formal and stringent forecast verification suggests that the forecasts post-processed via NCQRNN attain the maximum sharpness subject to calibration,amongst all competitors.Furthermore,the proposed conception to resolve quantile crossing is remarkably simple yet general,and thus has broad applicability as it can be integrated with many shallow-and deep-learning-based neural networks.

Weather Forecasting in China

Relying on advanced technology, China has greatly improved its meteorological service in the past few years. The modern meteorological technical system has played an important role in preventing and reducing damage from natural disasters, thus helping to advance China’s economic construction. Meanwhile, the field has benefitted from international cooperation on scientific research and meteorological education. Women meteorologists have been essential to this process.

A STUDY OF THE INFLUENCE OF MICROPHYSICAL PROCESSES ON TYPHOON NIDA(2016) USING A NEW DOUBLE-MOMENT MICROPHYSICS SCHEME IN THE WEATHER RESEARCH AND FORECASTING MODEL

The basic structure and cloud features of Typhoon Nida(2016) are simulated using a new microphysics scheme(Liuma) within the Weather Research and Forecasting(WRF) model. Typhoon characteristics simulated with the Liuma microphysics scheme are compared with observations and those simulated with a commonly-used microphysics scheme(WSM6). Results show that using different microphysics schemes does not significantly alter the track of the typhoon but does significantly affect the intensity and the cloud structure of the typhoon. Results also show that the vertical distribution of cloud hydrometeors and the horizontal distribution of peripheral rainband are affected by the microphysics scheme. The mixing ratios of rain water and graupel correlate highly with the vertical velocity component and equivalent potential temperature at the typhoon eye-wall region. According to the simulation with WSM 6 scheme,it is likely that the very low typhoon central pressure results from the positive feedback between hydrometeors and typhoon intensity. As the ice-phase hydrometeors are mostly graupel in the Liuma microphysics scheme, further improvement in this aspect is required.

A Methodological Study on Using Weather Research and Forecasting(WRF) Model Outputs to Drive a One-Dimensional Cloud Model

A new method for driving a One-Dimensional Stratiform Cold （1DSC） cloud model with Weather Research and Fore casting （WRF） model outputs was developed by conducting numerical experiments for a typical large-scale stratiform rainfall event that took place on 4-5 July 2004 in Changchun, China. Sensitivity test results suggested that, with hydrometeor pro files extracted from the WRF outputs as the initial input, and with continuous updating of soundings and vertical velocities （including downdraft） derived from the WRF model, the new WRF-driven 1DSC modeling system （WRF-1DSC） was able to successfully reproduce both the generation and dissipation processes of the precipitation event. The simulated rainfall intensity showed a time-lag behind that observed, which could have been caused by simulation errors of soundings, vertical velocities and hydrometeor profiles in the WRF output. Taking into consideration the simulated and observed movement path of the precipitation system, a nearby grid point was found to possess more accurate environmental fields in terms of their similarity to those observed in Changchun Station. Using profiles from this nearby grid point, WRF-1DSC was able to repro duce a realistic precipitation pattern. This study demonstrates that 1D cloud-seeding models do indeed have the potential to predict realistic precipitation patterns when properly driven by accurate atmospheric profiles derived from a regional short range forecasting system, This opens a novel and important approach to developing an ensemble-based rain enhancement prediction and operation system under a probabilistic framework concept.

Experiments in Forecasting Mesoscale Convective Weather over Changjiang Delta

The real time operational severe convective weather forecast experiment carried out during May to July in 1990 over the Changjiang Delta is briefly described. The heavy rainfall and severe conveetive weather forecast worksheets for the Changjiang Delta have been proposed and used in the daily forecasting. Results show that the ability of 0-12h convective weather prediction has been improved significantly after the development of the forecast methods and the establishment of a mesoscale forecast base at Shanghai Meteorological Center during 1986 to 1990.Three cases of convective weather systems (meso-alpha, meso-beta, meso-gamma) during the experiment period are described and discussed.

Artificial Intelligence Based Meteorological Parameter Forecasting for Optimizing Response of Nuclear Emergency Decision Support System

This paper presents a novel artificial intelligence (AI) based approach to predict crucial meteorological parameters such as temperature,pressure,and wind speed,typically calculated from computationally intensive weather research and forecasting (WRF) model.Accurate meteorological data is indispensable for simulating the release of radioactive effluents,especially in dispersion modeling for nuclear emergency decision support systems.Simulation of meteorological conditions during nuclear emergencies using the conventional WRF model is very complex and time-consuming.Therefore,a new artificial neural network (ANN) based technique was proposed as a viable alternative for meteorological prediction.A multi-input multi-output neural network was trained using historical site-specific meteorological data to forecast the meteorological parameters.Comprehensive evaluation of this technique was conducted to test its performance in forecasting various parameters including atmospheric pressure,temperature,and wind speed components in both East-West and North-South directions.The performance of developed network was evaluated on an unknown dataset,and acquired results are within the acceptable range for all meteorological parameters.Results show that ANNs possess the capability to forecast meteorological parameters,such as temperature and pressure,at multiple spatial locations within a grid with high accuracy,utilizing input data from a single station.However,accuracy is slightly compromised when predicting wind speed components.Root mean square error (RMSE) was utilized to report the accuracy of predicted results,with values of 1.453℃for temperature,77 Pa for predicted pressure,1.058 m/s for the wind speed of U-component and 0.959 m/s for the wind speed of V-component.In conclusion,this approach offers a precise,efficient,and wellinformed method for administrative decision-making during nuclear emergencies.

Development of New Capabilities Using Machine Learning for Space Weather Prediction

With the development of space exploration and space environment measurements,the numerous observations of solar,solar wind,and near Earth space environment have been obtained in last 20 years.The accumulation of multiple data makes it possible to better use machine learning technique,which has achieved unforeseen results in industrial applications in last decades,for developing new approaches and models in space weather investigation and prediction.In this paper,the efforts on the forecasting methods for space weather indices,events,and parameters using machine learning are briefly introduced based on the study works in recent years.These investigations indicate that machine learning,especially deep learning technique can be used in automatic characteristic identification,solar eruption prediction,space weather forecasting for solar and geomagnetic indices,and modeling of space environment parameters.

A Hybrid Methodology for Short Term Temperature Forecasting

Developing a reliable weather forecasting model is a complicated task, as it requires heavy IT resources as well as heavy investments beyond the financial capabilities of most countries. In Lebanon, the prediction model used by the civil aviation weather service at Rafic Hariri International Airport in Beirut (BRHIA) is the ARPEGE model, (0.5) developed by the weather service in France. Unfortunately, forecasts provided by ARPEGE have been erroneous and biased by several factors such as the chaotic character of the physical modeling equations of some atmospheric phenomena (advection, convection, etc.) and the nature of the Lebanese topography. In this paper, we proposed the time series method ARIMA (Auto Regressive Integrated Moving Average) to forecast the minimum daily temperature and compared its result with ARPEGE. As a result, ARIMA method shows better mean accuracy (91%) over the numerical model ARPEGE (68%), for the prediction of five days in January 2017. Moreover, back to five months ago, in order to validate the accuracy of the proposed model, a simulation has been applied on the first five days of August 2016. Results have shown that the time series ARIMA method has offered better mean accuracy (98%) over the numerical model ARPEGE (89%) for the prediction of five days of August 2016. This paper discusses a multiprocessing approach applied to ARIMA in order to enhance the efficiency of ARIMA in terms of complexity and resources.

Probability Forecast of Regional Landslide Based on Numerical Weather Forecast

The regional forecast of landslide is one of the key points of hazard mitigation. It is also a hot and difficult point in research field. To solve this problem has become urgent task along with Chinese economy fast development. This paper analyzes the principle of regional landslide forecast and the factors for forecasting. The method of a combination of Information Value Model and Extension Model has been put forward to be as the forecast model. Using new result of Numerical Weather Foreeast Research and that combination model, we discuss the implementation feasibility of regional landslide forecast. Finally, with the help of Geographic Information System, an operation system for southwest of China landslide forecast has been developed. It can carry out regional landslide forecast daily and has been pilot run in NMC. Since this is the first time linking theoretical research with meteorological service, further works are needed to enhance it.