Advances in Deep-Learning-based Precipitation Nowcasting Techniques

Precipitation nowcasting,as a crucial component of weather forecasting,focuses on predicting very short-range precipitation,typically within six hours.This approach relies heavily on real-time observations rather than numerical weather models.The core concept involves the spatio-temporal extrapolation of current precipitation fields derived from ground radar echoes and/or satellite images,which was generally actualized by employing computer image or vision techniques.Recently,with stirring breakthroughs in artificial intelligence(AI)techniques,deep learning(DL)methods have been used as the basis for developing novel approaches to precipitation nowcasting.Notable progress has been obtained in recent years,manifesting the strong potential of DL-based nowcasting models for their advantages in both prediction accuracy and computational cost.This paper provides an overview of these precipitation nowcasting approaches,from which two stages along the advancing in this field emerge.Classic models that were established on an elementary neural network dominated in the first stage,while large meteorological models that were based on complex network architectures prevailed in the second.In particular,the nowcasting accuracy of such data-driven models has been greatly increased by imposing suitable physical constraints.The integration of AI models and physical models seems to be a promising way to improve precipitation nowcasting techniques further.

Systematic Review on Ground-Based Cloud Tracking Methods for Photovoltaics Nowcasting

Renewable energies are highly dependent on local weather conditions, with photovoltaic energy being particularly affected by intermittent clouds. Anticipating the impact of cloud shadows on power plants is crucial, as clouds can cause partial shading, excessive irradiation, and operational issues. This study focuses on analyzing cloud tracking methods for short-term forecasts, aiming to mitigate such impacts. We conducted a systematic literature review, highlighting the most significant articles on cloud tracking from ground-based observations. We explore both traditional image processing techniques and advances in deep learning models. Additionally, we discuss current challenges and future research directions in this rapidly evolving field, aiming to provide a comprehensive overview of the state of the art and identify opportunities for significant advancements in the next generation of cloud tracking systems based on computer vision and deep learning.

调频Guassian小波在从NOWCAST图获取SST中的应用

温跃层对于潜艇的水下航行和战斗具有十分重要的意义。由于中国的现状,无法获取大量高精度的SST资料,给研究带来了很大的障碍。该文针对数据获取比较困难和数据精度不高的现状,提出了将图形的颜色表示从RGB空间转换到HIS空间来构造一时间序列,并对此序列用调频Guassian小波来进行分解和重构,其所得的低频信号能很好地还原出颜色变量中所包含地温度信息。经实验证明,该方法比传统的处理方法有了十分明显的提高,所得到的温度数据精度高,能满足温跃层研究的需要。

Application of Multi-Scale Tracking Radar Echoes Scheme in Quantitative Precipitation Nowcasting

A new radar echo tracking algorithm known as multi-scale tracking radar echoes by cross-correlation （MTREC） was developed in this study to analyze movements of radar echoes at different spatial scales. Movement of radar echoes, particularly associated with convective storms, exhibits different characteristics at various spatial scales as a result of complex interactions among meteorological systems leading to the formation of convective storms. For the null echo region, the usual correlation technique produces zero or a very small magnitude of motion vectors. To mitigate these constraints, MTREC uses the tracking radar echoes by correlation （TREC） technique with a large ＂box＂ to determine the systematic movement driven by steering wind, and MTREC applies the TREC technique with a small ＂box＂ to estimate small-scale internal motion vectors. Eventually, the MTREC vectors are obtained by synthesizing the systematic motion and the small-scale internal motion. Performance of the MTREC technique was compared with TREC technique using case studies： the Khanun typhoon on 11 September 2005 observed by Wenzhou radar and a squall-line system on 23 June 2011 detected by Beijing radar. The results demonstrate that more spatially smoothed and continuous vector fields can be generated by the MTREC technique, which leads to improvements in tracking the entire radar reflectivity pattern. The new multi-scMe tracking scheme was applied to study its impact on the performance of quantitative precipitation nowcasting. The location and intensity of heavy precipitation at a 1-h lead time was more consistent with quantitative precipitation estimates using radar and rain gauges.

Lightning Nowcasting with an Algorithm of Thunderstorm Tracking Based on Lightning Location Data over the Beijing Area

A thunderstorm tracking algorithm is proposed to nowcast the possibility of lightning activity over an area of concern by using the total lightning data and neighborhood technique.The lightning radiation sources observed from the Beijing Lightning Network(BLNET)were used to obtain information about the thunderstorm cells,which are significantly valuable in real-time.The boundaries of thunderstorm cells were obtained through the neighborhood technique.After smoothing,these boundaries were used to track the movement of thunderstorms and then extrapolated to nowcast the lightning approaching in an area of concern.The algorithm can deliver creditable results prior to a thunderstorm arriving at the area of concern,with accuracies of 63%,80%,and 91%for lead times of 30,15,and 5 minutes,respectively.The real-time observations of total lightning appear to be significant for thunderstorm tracking and lightning nowcasting,as total lightning tracking could help to fill the observational gaps in radar reflectivity due to the attenuation by hills or other obstacles.The lightning data used in the algorithm performs well in tracking the active thunderstorm cells associated with lightning activities.

Development of typhoon driven wave nowcasting model in Southeast China Sea

Using optimal interpolation data assimilation of observed wave spectrum around Northeast coast of Taiwan Island, the typhoon driven wave nowcasting model in Southeast China Sea is setup. The SWAN (simulating waves nearshore) model is used to calculate wave field and the input wind field is the QSCAT/NCEP (Quick Scatterometer/National Centers for Environmental Prediction) data. The two-dimensional wavelet transform is applied to analyze the X-band radar image of nearshore wave field and it reveals that the observed wave spectrum has shoaling characteristics in frequency domain. The reverse calculation approach of wave spectrum in deep water is proposed and validated with experimental tests. The two-dimensional digital low-pass filter is used to obtain the initialization wave field. Wave data during Typhoon Sinlaku is used to calibrate the data assimilation parameters and test the reverse calculation approach. Data assimilation corrects the significant wave height and the low frequency spectra energy evidently at Beishuang Station along Fujian Province coast, where the entire assimilation indexes are positive in verification moments. The nowcasting wave field shows that the present model can obtain more accurate wave predictions for coastal and ocean engineering in Southeast China Sea.

Methods of Lightning Nowcasting Based on Radar Echo Extrapolation Technology

An improved echo extrapolation technology( MOD-COTREC) was introduced firstly,and then two plans for lightning nowcasting based on MOD-COTREC and both isothermal radar reflectivity and MOD-COTREC were proposed based on the technology. Afterwards,the two plans for lightning nowcasting were tested by a case respectively. It is concluded that during the process of lightning nowcasting singly based on MOD-COTREC,the appearance and disappearance of lightning are not considered,and only lightning position is predicted when lightning density is constant,so the prediction error is big. The plan for lightning nowcasting based on both isothermal radar reflectivity and MOD-COTREC is still at an experimental stage,and the nowcasting products of cloud-to-ground lightning based on the plan are very different from the actual density and position of cloud-to-ground lightning,so it needs to be improved further.

Evaluation of the Added Value of Probabilistic Nowcasting Ensemble Forecasts on Regional Ensemble Forecasts

Ensemble forecasting systems have become an important tool for estimating the uncertainties in initial conditions and model formulations and they are receiving increased attention from various applications.The Regional Ensemble Prediction System(REPS),which has operated at the Beijing Meteorological Service(BMS)since 2017,allows for probabilistic forecasts.However,it still suffers from systematic deficiencies during the first couple of forecast hours.This paper presents an integrated probabilistic nowcasting ensemble prediction system(NEPS)that is constructed by applying a mixed dynamicintegrated method.It essentially combines the uncertainty information(i.e.,ensemble variance)provided by the REPS with the nowcasting method provided by the rapid-refresh deterministic nowcasting prediction system(NPS)that has operated at the Beijing Meteorological Service(BMS)since 2019.The NEPS provides hourly updated analyses and probabilistic forecasts in the nowcasting and short range(0-6 h)with a spatial grid spacing of 500 m.It covers the three meteorological parameters:temperature,wind,and precipitation.The outcome of an evaluation experiment over the deterministic and probabilistic forecasts indicates that the NEPS outperforms the REPS and NPS in terms of surface weather variables.Analysis of two cases demonstrates the superior reliability of the NEPS and suggests that the NEPS gives more details about the spatial intensity and distribution of the meteorological parameters.

Summary on Applications of Stratiform Clear Air Echo in Nowcasting

It was difficult to probe the clear air echo by the general traditional radar for echo's weak intensity.Therefore,its investigation was less because of the restrictions of probe technique and data.In recent years,with the probe tools improving,more clear air echoes were probed,and the relative investigations were more and more.However,most investigations stayed in the theory at present,and the relative literatures about its application in the practical forecast work were few.For a new generation of Doppler radars' powers and sensitivities were all high,they were put into service successively in China.People could observe more and more the clear air atmospheric echoes in the daily business.Its Doppler radar velocity provided the important basis for daily short-term predication and had very important indication meaning for the nowcasting of seasons which were spring,summer and fall.It was important to forecast the precipitation,especially the abrupt rainstorm by using the symptom of clear air echo which was probed by the new generation of Doppler radar products.Therefore,the advances on clear air echo research at home and abroad were summarized simply.

THE INFLUENCE OF CLOUD PARAMETERIZATION ADJUSTMENT USING REFLECTIVITY OF DOPPLER ON NOWCASTING WITH GRAPES MODEL

In this study, we attempted to improve the nowcasting of GRAPES model by adjusting the model initial field through modifying the cloud water, rain water and vapor as well as revising vapor-following rain water. The results show that the model nowcasting is improved when only the cloud water and rain water are adjusted or all of the cloud water, rain water and vapor are adjusted in the initial field. The forecasting of the former(latter) approach during 0-3(0-6) hours is significantly improved. Furthermore, for the forecast for 0-3 hours, the latter approach is better than the former. Compared with the forecasting results for which the vapor of the model initial field is adjusted by the background vapor with those by the revised vapor, the nowcasting of the revised vapor is much better than that of background vapor. Analysis of the reasons indicated that when the vapor is adjusted in the model initial field, especially when the saturated vapor is considered, the forecasting of the vapor field is significantly affected. The changed vapor field influences the circulation, which in turn improves the model forecasting of radar reflectivity and rainfall.

Convective Storm VIL and Lightning Nowcasting Using Satellite and Weather Radar Measurements Based on Multi-Task Learning Models

Convective storms and lightning are among the most important weather phenomena that are challenging to forecast.In this study,a novel multi-task learning(MTL)encoder-decoder U-net neural network was developed to forecast convective storms and lightning with lead times for up to 90 min,using GOES-16 geostationary satellite infrared brightness temperatures(IRBTs),lightning flashes from Geostationary Lightning Mapper(GLM),and vertically integrated liquid(VIL)from Next Generation Weather Radar(NEXRAD).To cope with the heavily skewed distribution of lightning data,a spatiotemporal exponent-weighted loss function and log-transformed lightning normalization approach were developed.The effects of MTL,single-task learning(STL),and IRBTs as auxiliary input features on convection and lightning nowcasting were investigated.The results showed that normalizing the heavily skew-distributed lightning data along with a log-transformation dramatically outperforms the min-max normalization method for nowcasting an intense lightning event.The MTL model significantly outperformed the STL model for both lightning nowcasting and VIL nowcasting,particularly for intense lightning events.The MTL also helped delay the lightning forecast performance decay with the lead times.Furthermore,incorporating satellite IRBTs as auxiliary input features substantially improved lightning nowcasting,but produced little difference in VIL forecasting.Finally,the MTL model performed better for forecasting both lightning and the VIL of organized convective storms than for isolated cells.

An Assessment of a Nowcast/Forecast System for the Straits of Florida/Florida Current Regime

The Florida Current （FC） largely fills the Straits of Florida and is variable on a broad spectrum of time and space scales. Some portions of the variability are due to variable forcing by tides, winds, heating/cooling, and throughflow; other portions are due to intrinsic instabilities of the FC. To predict, as well as to better understand this complex regime, a nowcast/forecast system （East Florida Shelf Information System （EFSIS）） has been implemented and assessed （http：//efsis. rsmas. miami. edu）. EFSIS is based on an implementation of the Princeton Ocean Model （POM） with mesoscale-admitting resolution on a curvilinear grid. It is forced by a mesoscale numerical weather prediction system （called Eta） run operationally by the National Centers for Environmental Prediction （NCEP）, eight tidal constituents from a global tidal model, and lateral boundary conditions from an operational global ocean prediction model, i.e., the Navy Coastal Ocean Model （NCOM）. Real-time observations of coastal sea level, coastal sea surface temperature, coastal HF radar-derived surface current maps, and FC volume transport are used to verify and validate EFSIS. EFSIS is part of an evolving strategy for real-time predictive coastal ocean modeling methodology, and for fostering the understanding of the variability of the regime on several time and space scales. Here, some of the verification and validation results are provided, as well as diagnostic analyses of dynamical processes. The central point is that an example is provided of a ＇scientific revolution＇ in progress that combines real-time observations and numerical circulation models to yield a credible sequence of synoptic views of coastal ocean circulation for the first time.

Modelling the ZR Relationship of Precipitation Nowcasting Based on Deep Learning

Sudden precipitations may bring troubles or even huge harm to people’s daily lives.Hence a timely and accurate precipitation nowcasting is expected to be an indispensable part of our modern life.Traditionally,the rainfall intensity estimation from weather radar is based on the relationship between radar reflectivity factor(Z)and rainfall rate(R),which is typically estimated by location-dependent experiential formula and arguably uncertain.Therefore,in this paper,we propose a deep learning-based method to model the ZR relation.To evaluate,we conducted our experiment with the Shenzhen precipitation dataset.We proposed a combined method of deep learning and the ZR relationship,and compared it with a traditional ZR equation,a ZR equation with its parameters estimated by the least square method,and a pure deep learning model.The experimental results show that our combined model performsmuch better than the equation-based ZRformula and has the similar performance with a pure deep learning nowcasting model,both for all level precipitation and heavy ones only.

A Novel Method for Precipitation Nowcasting Based on ST-LSTM

Precipitation nowcasting is of great significance for severe convective weather warnings.Radar echo extrapolation is a commonly used precipitation nowcasting method.However,the traditional radar echo extrapolation methods are encountered with the dilemma of low prediction accuracy and extrapolation ambiguity.The reason is that those methods cannot retain important long-term information and fail to capture short-term motion information from the long-range data stream.In order to solve the above problems,we select the spatiotemporal long short-term memory(ST-LSTM)as the recurrent unit of the model and integrate the 3D convolution operation in it to strengthen the model’s ability to capture short-term motion information which plays a vital role in the prediction of radar echo motion trends.For the purpose of enhancing the model’s ability to retain long-term important information,we also introduce the channel attention mechanism to achieve this goal.In the experiment,the training and testing datasets are constructed using radar data of Shanghai,we compare our model with three benchmark models under the reflectance thresholds of 15 and 25.Experimental results demonstrate that the proposed model outperforms the three benchmark models in radar echo extrapolation task,which obtains a higher accuracy rate and improves the clarity of the extrapolated image.

Segmentation and Classification of Individual Clouds in Images Captured with Horizon-Aimed Cameras for Nowcasting of Solar Irradiance Absorption

One important aspect of solar energy generation especially in inter-tropical sites is the local variability of clouds. Satellite images do not have temporal resolution enough to nowcast its impacts on solar plants, this monitoring is made by local cameras. However, cloud detection and monitoring are not trivial due to cloud shape dynamics, the camera is a linear and self-adjusting device, with fish-eye lenses generating a flat image that distorts images near the horizon. The present work focuses on cloud identification to predict its effects on solar plants that are distinct for every site’s climatology and geography. We used RASPBERY-PI-based cameras pointed at the horizon to allow observation of clouds’ vertical distribution, not possible with a unique fish-eye lens. A large number of cloud image identification analyses led the researchers to use deep learning methods such as U-net, HRnet, and Detectron. We use transfer learning with weights trained over the “2012 ILSVRC ImageNet” data set and architecture configurations like Resnet, Efficient, and Detectron2. While cloud identification proved a difficult task, we achieved the best results by using Jaccard Coefficient as a validation metric, with the best model being a U-net with Resnet18 using 486 × 648 resolution. This model had an average IoU of 0.6, indicating a satisfactory performance in cloud segmentation. We also observed that the data imbalance affected the overall performance of all models, with the tree class creating a favorable bias. The HRNet model, which works with different resolutions, showed promising results with a more refined segmentation at the pixel level, but it was not necessary to detect the most predominant clouds in the sky. We are currently working on balancing the dataset and mapping out data augmentation transformations for our next experiments. Our ultimate goal is to use such models to predict cloud motion and forecast the impact it will have on solar power generation. The present work has contributed to a better understanding of what techniques work best for cloud identification and paves the way for future studies on the development of a better overall cloud classification model.

A convolutional recurrent neural network for strong convective rainfall nowcasting using weather radar data in Southeastern Brazil

Strong convective systems and the associated heavy rainfall events can trig-ger floods and landslides with severe detrimental consequences.These events have a high spatio-temporal variability,being difficult to predict by standard meteorological numerical models.This work proposes the M5Images method for performing the very short-term prediction(nowcasting)of heavy convective rainfall using weather radar data by means of a convolutional recurrent neural network.The recurrent part of it is a Long Short-Term Memory(LSTM)neural network.Prediction tests were performed for the city and surroundings of Campinas,located in the Southeastern Brazil.The convolutional recurrent neural network was trained using time series of rainfall rate images derived from weather radar data for a selected set of heavy rainfall events.The attained pre-diction performance was better than that given by the persistence forecasting method for different prediction times.

MGCPN:An Efficient Deep Learning Model for Tibetan Plateau Precipitation Nowcasting Based on the IMERG Data

The sparse and uneven placement of rain gauges across the Tibetan Plateau(TP) impedes the acquisition of precise,high-resolution precipitation measurements,thus challenging the reliability of forecast data.To address such a challenge,we introduce a model called Multisource Generative Adversarial Network-Convolutional Long Short-Term Memory(GAN-ConvLSTM) for Precipitation Nowcasting(MGCPN),which utilizes data products from the Integrated Multi-satellite Retrievals for global precipitation measurement(IMERG) data,offering high spatiotemporal resolution precipitation forecasts for upcoming periods ranging from 30 to 300 min.The results of our study confirm that the implementation of the MGCPN model successfully addresses the problem of underestimating and blurring precipitation results that often arise with increasing forecast time.This issue is a common challenge in precipitation forecasting models.Furthermore,we have used multisource spatiotemporal datasets with integrated geographic elements for training and prediction to improve model accuracy.The model demonstrates its competence in generating precise precipitation nowcasting with IMERG data,offering valuable support for precipitation research and forecasting in the TP region.The metrics results obtained from our study further emphasize the notable advantages of the MGCPN model;it outperforms the other considered models in the probability of detection(POD),critical success index,Heidke Skill Score,and mean absolute error,especially showing improvements in POD by approximately 33%,19%,and 8% compared to Convolutional Gated Recurrent Unit(ConvGRU),ConvLSTM,and small Attention-UNet(SmaAt-UNet) models.

Quantitative Applications of Weather Satellite Data for Nowcasting:Progress and Challenges

Monitoring and predicting highly localized weather events over a very short-term period,typically ranging from minutes to a few hours,are very important for decision makers and public action.Nowcasting these events usually relies on radar observations through monitoring and extrapolation.With advanced high-resolution imaging and sounding observations from weather satellites,nowcasting can be enhanced by combining radar,satellite,and other data,while quantitative applications of those data for nowcasting are advanced through using machine learning techniques.Those applications include monitoring the location,impact area,intensity,water vapor,atmospheric instability,precipitation,physical properties,and optical properties of the severe storm at different stages(pre-convection,initiation,development,and decaying),identification of storm types(wind,snow,hail,etc.),and predicting the occurrence and evolution of the storm.Satellite observations can provide information on the environmental characteristics in the preconvection stage and are very useful for situational awareness and storm warning.This paper provides an overview of recent progress on quantitative applications of satellite data in nowcasting and its challenges,and future perspectives are also addressed and discussed.

机器学习、文本大数据与Nowcasting即时预测

即时预测宏观经济具有重要的现实意义,Nowcasting通过实时数据分析,能够为决策者提供决策参考。本文针对传统计量经济学模型的不足,分析了机器学习方法在Nowcasting中非线性和时变性的优缺点。与传统数据相比,文本大数据具有多样性、异构性、大规模性、时频高等特征,提供了新信息源,在适当的学习方法下有助于提升预测的精度,为经济决策和市场预测提供更准确、及时的支持。

Time-Series Embeddings from Language Models:A Tool for Wind Direction Nowcasting

Wind direction nowcasting is crucial in various sectors,particularly for ensuring aviation operations and safety.In this context,the TELMo(Time-series Embeddings from Language Models)model,a sophisticated deep learning architecture,has been introduced in this work for enhanced wind-direction nowcasting.Developed by using three years of data from multiple stations in the complex terrain of an international airport,TELMo incorporates the horizontal u(east-west)and v(north-south)wind components to significantly reduce forecasting errors.On a day with high wind direction variability,TELMo achieved mean absolute error values of 5.66 for 2-min,10.59 for 10-min,and 14.79 for 20-min forecasts,processed within a swift 9-ms/step timeframe.Standard degree-based analysis,in comparison,yielded lower performance,emphasizing the effectiveness of the u and v components.In contrast,a Vanilla neural network,representing a shallow-learning approach,underperformed in all analyses,highlighting the superiority of deep learning methodologies in wind direction nowcasting.TELMo is an efficient model,capable of accurately forecasting wind direction for air traffic operations,with an error less than 20°in 97.49%of the predictions,aligning with recommended international thresholds.This model design enables its applicability across various geographical locations,making it a versatile tool in global aviation meteorology.