Algorithm Studies on How to Obtain a Conditional Nonlinear Optimal Perturbation (CNOP)

The conditional nonlinear optimal perturbation （CNOP）, which is a nonlinear generalization of the linear singular vector （LSV）, is applied in important problems of atmospheric and oceanic sciences, including ENSO predictability, targeted observations, and ensemble forecast. In this study, we investigate the computational cost of obtaining the CNOP by several methods. Differences and similarities, in terms of the computational error and cost in obtaining the CNOP, are compared among the sequential quadratic programming （SQP） algorithm, the limited memory Broyden-Fletcher-Goldfarb-Shanno （L-BFGS） algorithm, and the spectral projected gradients （SPG2） algorithm. A theoretical grassland ecosystem model and the classical Lorenz model are used as examples. Numerical results demonstrate that the computational error is acceptable with all three algorithms. The computational cost to obtain the CNOP is reduced by using the SQP algorithm. The experimental results also reveal that the L-BFGS algorithm is the most effective algorithm among the three optimization algorithms for obtaining the CNOP. The numerical results suggest a new approach and algorithm for obtaining the CNOP for a large-scale optimization problem.

Ensemble Forecasts of Tropical Cyclone Track with Orthogonal Conditional Nonlinear Optimal Perturbations

This paper preliminarily investigates the application of the orthogonal conditional nonlinear optimal perturbations(CNOPs)–based ensemble forecast technique in MM5(Fifth-generation Pennsylvania State University–National Center for Atmospheric Research Mesoscale Model). The results show that the ensemble forecast members generated by the orthogonal CNOPs present large spreads but tend to be located on the two sides of real tropical cyclone(TC) tracks and have good agreements between ensemble spreads and ensemble-mean forecast errors for TC tracks. Subsequently, these members reflect more reasonable forecast uncertainties and enhance the orthogonal CNOPs–based ensemble-mean forecasts to obtain higher skill for TC tracks than the orthogonal SVs(singular vectors)–, BVs(bred vectors)– and RPs(random perturbations)–based ones. The results indicate that orthogonal CNOPs of smaller magnitudes should be adopted to construct the initial ensemble perturbations for short lead–time forecasts, but those of larger magnitudes should be used for longer lead–time forecasts due to the effects of nonlinearities. The performance of the orthogonal CNOPs–based ensemble-mean forecasts is case-dependent,which encourages evaluating statistically the forecast skill with more TC cases. Finally, the results show that the ensemble forecasts with only initial perturbations in this work do not increase the forecast skill of TC intensity, which may be related with both the coarse model horizontal resolution and the model error.

Application of the Conditional Nonlinear Optimal Perturbation Method to the Predictability Study of the Kuroshio Large Meander

A reduced-gravity barotropic shallow-water model was used to simulate the Kuroshio path variations. The results show that the model was able to capture the essential features of these path variations. We used one simulation of the model as the reference state and investigated the effects of errors in model parameters on the prediction of the transition to the Kuroshio large meander （KLM） state using the conditional nonlinear optimal parameter perturbation （CNOP-P） method. Because of their relatively large uncertainties, three model parameters were considered： the interracial friction coefficient, the wind-stress amplitude, and the lateral friction coefficient. We determined the CNOP-Ps optimized for each of these three parameters independently, and we optimized all three parameters simultaneously using the Spectral Projected Gradient 2 （SPG2） algorithm. Similarly, the impacts caused by errors in initial conditions were examined using the conditional nonlinear optimal initial perturbation （CNOP-I） method. Both the CNOP-I and CNOP-Ps can result in significant prediction errors of the KLM over a lead time of 240 days. But the prediction error caused by CNOP-I is greater than that caused by CNOP-P. The results of this study indicate not only that initial condition errors have greater effects on the prediction of the KLM than errors in model parameters but also that the latter cannot be ignored. Hence, to enhance the forecast skill of the KLM in this model, the initial conditions should first be improved, the model parameters should use the best possible estimates.

A Variant Constrained Genetic Algorithm for Solving Conditional Nonlinear Optimal Perturbations

A variant constrained genetic algorithm （VCGA） for effective tracking of conditional nonlinear optimal perturbations （CNOPs） is presented. Compared with traditional constraint handling methods, the treatment of the constraint condition in VCGA is relatively easy to implement. Moreover, it does not require adjustments to indefinite pararneters. Using a hybrid crossover operator and the newly developed multi-ply mutation operator, VCGA improves the performance of GAs. To demonstrate the capability of VCGA to catch CNOPS in non-smooth cases, a partial differential equation, which has ＂on off＂ switches in its forcing term, is employed as the nonlinear model. To search global CNOPs of the nonlinear model, numerical experiments using VCGA, the traditional gradient descent algorithm based on the adjoint method （ADJ）, and a GA using tournament selection operation and the niching technique （GA-DEB） were performed. The results with various initial reference states showed that, in smooth cases, all three optimization methods are able to catch global CNOPs. Nevertheless, in non-smooth situations, a large proportion of CNOPs captured by the ADJ are local. Compared with ADJ, the performance of GA-DEB shows considerable improvement, but it is far below VCGA. Further, the impacts of population sizes on both VCGA and GA-DEB were investigated. The results were used to estimate the computation time of ~CGA and GA-DEB in obtaining CNOPs. The computational costs for VCGA, GA-DEB and ADJ to catch CNOPs of the nonlinear model are also compared.

Application of the Conditional Nonlinear Optimal Perturbations Method in a Theoretical Grassland Ecosystem

Using a simplified nonlinearly theoretical grassland ecosystem proposed by Zeng et al.,we study the sensitivity and nonlinear instability of the grassland ecosystem to finiteamplitude initial perturbations with the approach of conditional nonlinear optimal perturbation （CNOP）.The results show that the linearly stable grassland （desert or latent desert） states can turn to be nonlinearly unstable with finite amplitude initial perturbations.When the precipitation is between the two bifurcation points,a large enough finite amplitude initial perturbation can induce a transition between the grassland statethe desert state or the latent desert.

Applications of Conditional Nonlinear Optimal Perturbation to the Study of the Stability and Sensitivity of the Jovian Atmosphere

A two-layer quasi-geostrophic model is used to study the stability and sensitivity of motions on smallscale vortices in Jupiter＇s atmosphere. Conditional nonlinear optimal perturbations （CNOPs） and linear singular vectors （LSVs） are both obtained numerically and compared in this paper. The results show that CNOPs can capture the nonlinear characteristics of motions in small-scale vortices in Jupiter＇s atmosphere and show great difference from LSVs under the condition that the initial constraint condition is large or the optimization time is not very short or both. Besides, in some basic states, local CNOPs are found. The pattern of LSV is more similar to local CNOP than global CNOP in some cases. The elementary application of the method of CNOP to the Jovian atmosphere helps us to explore the stability of variousscale motions of Jupiter＇s atmosphere and to compare the stability of motions in Jupiter＇s atmosphere and Earth＇s atmosphere further.

THE EFFECTIVENESS OF GENETIC ALGORITHM IN CAPTURING CONDITIONAL NONLINEAR OPTIMAL PERTURBATION WITH PARAMETERIZATION “ON-OFF” SWITCHES INCLUDED BY A MODEL

In the typhoon adaptive observation based on conditional nonlinear optimal perturbation (CNOP), the ‘on-off’ switch caused by moist physical parameterization in prediction models prevents the conventional adjoint method from providing correct gradient during the optimization process. To address this problem, the capture of CNOP, when the "on-off" switches are included in models, is treated as non-smooth optimization in this study, and the genetic algorithm (GA) is introduced. After detailed algorithm procedures are formulated using an idealized model with parameterization "on-off" switches in the forcing term, the impacts of "on-off" switches on the capture of CNOP are analyzed, and three numerical experiments are conducted to check the effectiveness of GA in capturing CNOP and to analyze the impacts of different initial populations on the optimization result. The result shows that GA is competent for the capture of CNOP in the context of the idealized model with parameterization ‘on-off’ switches in this study. Finally, the advantages and disadvantages of GA in capturing CNOP are analyzed in detail.

THE APPLICATION OF CONDITIONAL NONLINEAR OPTIMAL PERTURBATION TO THE BINARY TYPHOONS INTERACTION —FENGSHEN AND FUNG-WONG

The interaction between the typhoons Fengshen and Fung-wong over the Western Pacific in 2002 is studied with the Conditional Nonlinear Optimal Perturbation(CNOP) method.The study discovered that the CNOP method reveals the process of one-way interaction between Fengshen and Fung-wong.Moreover,if the region of Fung-wong was selected for verification,the sensitivity area was mainly located in the region of Fengshen and presented a half-ring structure;if the region of Fengshen was selected for verification,most of the sensitivity areas were located in the region between the Fengshen and the subtropical high,far away from Fung-wong.This indicated that Fung-wong is mainly steered by Fengshen,but Fengshen is mainly affected by the subtropical high.The sensitivity experiment showed that the initial errors in the CNOP-identified sensitive areas have larger impacts on the verification-area prediction than those near the typhoon center and their developments take a large proportion in the whole domain.This suggests that the CNOP-identified sensitive areas do have large influence on the verification-area prediction.

Inducing Unstable Grassland Equilibrium States Due to Nonlinear Optimal Patterns of Initial and Parameter Perturbations:Theoretical Models

Due to uncertainties in initial conditions and parameters, the stability and uncertainty of grassland ecosystem simulations using ecosystem models are issues of concern. Our objective is to determine the types and patterns of initial and parameter perturbations that yield the greatest instability and uncertainty in simulated grassland ecosystems using theoretical models. We used a nonlinear optimization approach, i.e., a conditional nonlinear optimal perturbation related to initial and parameter perturbations （CNOP） approach, in our work. Numerical results indicated that the CNOP showed a special and nonlinear optimal pattern when the initial state variables and multiple parameters were considered simultaneously. A visibly different complex optimal pattern characterizing the CNOPs was obtained by choosing different combinations of initial state variables and multiple parameters in different physical processes. We propose that the grassland modeled ecosystem caused by the CNOP-type perturbation is unstable and exhibits two aspects： abrupt change and the time needed for the abrupt change from a grassland equilibrium state to a desert equilibrium state when the initial state variables and multiple parameters are considered simultaneously. We compared these findings with results affected by the CNOPs obtained by considering only uncertainties in initial state variables and in a single parameter. The numerical results imply that the nonlinear optimal pattern of initial perturbations and parameter perturbations, especially for more parameters or when special parameters are involved, plays a key role in determining stabilities and uncertainties associated with a simulated or predicted grassland ecosystem.

Optimal nonlinear excitation of decadal variability of the North Atlantic thermohaline circulation

Nonlinear development of salinity perturbations in the Atlantic thermohaline circulation(THC) is investigated with a three-dimensional ocean circulation model,using the conditional nonlinear optimal perturbation method.The results show two types of optimal initial perturbations of sea surface salinity,one associated with freshwater and the other with salinity.Both types of perturbations excite decadal variability of the THC.Under the same amplitude of initial perturbation,the decadal variation induced by the freshwater perturbation is much stronger than that by the salinity perturbation,suggesting that the THC is more sensitive to freshwater than salinity perturbation.As the amplitude of initial perturbation increases,the decadal variations become stronger for both perturbations.For salinity perturbations,recovery time of the THC to return to steady state gradually saturates with increasing amplitude,whereas this recovery time increases remarkably for freshwater perturbations.A nonlinear(advective) feedback between density and velocity anomalies is proposed to explain these characteristics of decadal variability excitation.The results are consistent with previous ones from simple box models,and highlight the importance of nonlinear feedback in decadal THC variability.

Three-Dimensional Structure of Optimal Nonlinear Excitation for Decadal Variability of the Thermohaline Circulation

The decadal variability of the North Atlantic thermohaline circulation(THC) is investigated within a three-dimensional ocean circulation model using the conditional nonlinear optimal perturbation method. The results show that the optimal initial perturbations of temperature and salinity exciting the strongest decadal THC variations have similar structures: the perturbations are mainly in the northwestern basin at a depth ranging from 1500 to 3000 m. These temperature and salinity perturbations act as the optimal precursors for future modifications of the THC, highlighting the importance of observations in the northwestern basin to monitor the variations of temperature and salinity at depth. The decadal THC variation in the nonlinear model initialized by the optimal salinity perturbations is much stronger than that caused by the optimal temperature perturbations, indicating that salinity variations might play a relatively important role in exciting the decadal THC variability. Moreover, the decadal THC variations in the tangent linear and nonlinear models show remarkably different characteristics, suggesting the importance of nonlinear processes in the decadal variability of the THC.

基于CNOP方法的台风目标观测中三种敏感区确定方案的比较研究

在目标观测中,敏感区的确定是个关键性的问题。本文详细研究了如何用条件非线性最优扰动(CNOP)方法确定敏感区。提出了三种确定敏感区的方案:水平投影方案、单点能量投影方案以及垂直积分能量方案。比较了三种方案确定的敏感区的差异,分析了它们所阐释的物理意义,讨论了它们的优缺点,并通过理想回报试验考查了不同方案确定的敏感区的有效性。对六个台风个例的应用结果显示,单点能量投影方案与垂直积分能量方案下识别的敏感区较为相似,二者与水平投影方案确定的敏感区则有较大的区别。两种能量方案确定的敏感区更多地反映了环境场对台风的影响,而水平投影方案则反映了台风自身对流不对称性结构对台风发展变化的影响。理想回报试验结果表明,由两种能量方案确定的敏感区对预报误差能量的减小程度以及路径预报的改善程度都要大于水平投影方案确定的敏感区的效果,且垂直积分能量方案确定的敏感区的有效性最高。而在强度预报方面,三种方案对预报效果的改善程度相当。因此,总的说在台风目标观测研究中,利用CNOP方法确定敏感区时,垂直积分能量方案是较佳的方案。

条件非线性最优扰动(CNOP):简介与数值求解

介绍了条件非线性最优扰动(Conditional Nonlinear Optimal Perturbation,CNOP)的定义及其在大气和海洋等可预报性研究中的应用。根据研究对象不同,CNOP分为与初始扰动有关的CNOP(CNOP-I)方法、与模式参数扰动有关的CNOP(CNOP-P)方法和同时考虑初始扰动和模式参数扰动的CNOP方法。目前,CNOP-I方法已经应用于ENSO、黑潮和阻塞可预报性以及热盐环流和草原生态系统稳定性的研究。此外,CNOP-I方法也被应用于探讨台风目标观测的研究,利用CNOP-I方法能够识别出台风预报的初值敏感区,通过观测系统模拟试验表明在初值敏感区增加观测能够有效改进台风的预报技巧。CNOP-P方法也在ENSO和黑潮可预报性以及热盐环流和草原生态系统稳定性研究中得到了应用。为了将CNOP方法应用于更多的领域,本文利用一个简单的Burgers方程,介绍了如何通过建立Burgers方程的切线性模式和伴随模式,从而利用非线性最优化算法计算获得CNOP。这一数值试验为将CNOP方法应用于更多的领域提供了借鉴。

基于CNOP方法的台风目标观测研究进展

简要但系统地介绍了条件非线性最优扰动(CNOP)方法在台风目标观测方面的研究进展。CNOP方法是线性奇异向量(SV)方法在非线性领域的一个拓展。在台风目标观测的研究中,该方法主要用来识别对台风预报有重要影响的敏感区,从而可以在这些敏感区内增加观测,改进初始场以提高预报技巧。首先回顾了CNOP方法在台风目标观测中应用的理论基础,接着阐述了CNOP识别的敏感区受模式分辨率、验证区域的设计、优化时长的选取等因素的影响,并给出了利用观测系统模拟试验(OSSE)和观测系统试验(OSE)对CNOP识别的敏感区有效性检验的结果,进一步评述了将CNOP方法应用于实际天气业务预报中进行敏感区识别的可能性,最后对CNOP方法在台风目标观测中的深入应用进行了总结和讨论。

初始扰动振幅和集合样本数对CNOPs集合预报的影响

初始扰动振幅的大小和集合样本数对于集合预报取得更高预报技巧具有重要意义。本文将正交条件非线性最优扰动方法(orthogonal conditional nonlinear optimal perturbations,简称CNOPs)应用于概念模型Lorenz-96模式探讨了初始扰动振幅和集合样本数对集合预报技巧的影响,从而为使用更复杂模式进行集合预报提供指导。结果表明,由于CNOPs扮演了非线性系统中的最优初始扰动,从而使得当初始扰动振幅小于初始分析误差的大小时,CNOPs集合预报获得更高的预报技巧,并且CNOPs集合预报的最高预报技巧总是高于奇异向量法(singular vectors,简称SVs)集合预报的最高预报技巧。结果还表明,CNOPs集合预报倾向于具有一个合适的样本数时,达到最高技巧。更好的集合离散度--预报误差关系和更为平坦的Talagrand图(Talagrand diagram)进一步证明了CNOPs集合预报系统的可靠性,从而夯实了上述结果的合理性。因此,针对CNOPs集合预报,本文认为采用一个适当小于初始分析误差的初始扰动振幅和一个合适的集合样本数,有利于CNOPs集合预报达到最高预报技巧。

The application of the orthogonal conditional nonlinear optimal perturbations method to typhoon track ensemble forecasts

The orthogonal conditional nonlinear optimal perturbations (CNOPs) method, orthogonal singular vectors (SVs)method and CNOP+SVs method, which is similar to the orthogonal SVs method but replaces the leading SV (LSV) with the first CNOP, are adopted in both the Lorenz-96 model and Pennsylvania State University/National Center for Atmospheric Research (PSU/NCAR) Fifth-Generation Mesoscale Model (MM5) for ensemble forecasts. Using the MM5, typhoon track ensemble forecasting experiments are conducted for strong Typhoon Matsa in 2005. The results of the Lorenz-96 model show that the CNOP+SVs method has a higher ensemble forecast skill than the orthogonal SVs method, but ensemble forecasts using the orthogonal CNOPs method have the highest forecast skill. The results from the MM5 show that orthogonal CNOPs have a wider horizontal distribution and better describe the forecast uncertainties compared with SVs. When generating the ensemble mean forecast, equally averaging the ensemble members in addition to the anomalously perturbed forecast members may contribute to a higher forecast skill than equally averaging all of the ensemble members. Furthermore, for given initial perturbation amplitudes, the CNOP+SVs method may not have an ensemble forecast skill greater than that of the orthogonal SVs method, but the orthogonal CNOPs method is likely to have the highest forecast skill. Compared with SVs, orthogonal CNOPs fully consider the influence of nonlinear physical processes on the forecast results; therefore, considering the influence of nonlinearity may be important when generating fast-growing initial ensemble perturbations. All of the results show that the orthogonal CNOP method may be a potential new approach for ensemble forecasting.

Ensemble prediction experiments using conditional nonlinear optimal perturbation

Two methods for initialization of ensemble forecasts are compared, namely, singular vector (SV) and conditional nonlinear optimal perturbation (CNOP). The comparison is done for forecast lengths of up to 10 days with a three-level quasi-geostrophic (QG) atmospheric model in a perfect model scenario. Ten cases are randomly selected from 1982/1983 winter to 1993/1994 winter (from December to the following February). Anomaly correlation coefficient (ACC) is adopted as a tool to measure the quality of the predicted ensembles on the Northern Hemisphere 500 hPa geopotential height. The results show that the forecast quality of ensemble samples in which the first SV is replaced by CNOP is higher than that of samples composed of only SVs in the medium range, based on the occurrence of weather re-gime transitions in Northern Hemisphere after about four days. Besides, the reliability of ensemble forecasts is evaluated by the Rank Histograms. The above conclusions confirm and extend those reached earlier by the authors, which stated that the introduction of CNOP improves the forecast skill under the condition that the analysis error belongs to a kind of fast-growing error by using a barotropic QG model.

Application of Conditional Nonlinear Optimal Perturbation to Targeted Observation Studies of the Atmosphere and Ocean

This paper reviews progress in the application of conditional nonlinear optimal perturbation to targeted observation studies of the atmosphere and ocean in recent years, with a focus on the E1 Nifio-Southern Oscillation （ENSO）, Kuroshio path variations, and blocking events. Through studying the optimal precursor （OPR） and optimally growing initial error （OGE） of the occurrence of the above events, the similarity and localization features of OPR and OGE spatial structures have been found for each event. Ideal hindcasting experiments have shown that, if initial errors are reduced in the areas with the largest amplitude for the OPR and OGE for ENSO and Kuroshio path variations, the forecast skill of the model for these events is significantly improved. Due to the similarity between patterns of the OPR and OGE, additional observations implemented in the same sensitive region would help to not only capture the precursors, but also reduce the initial errors in the predictions, greatly increasing the forecast abilities. The similarity and localization of the spatial structures of the OPR and OGE during the onset of blocking events have also been investigated, but their application to targeted observation requires further study.

CNOP-P-based parameter sensitivity for double-gyre variation in ROMS with simulated annealing algorithm

Reducing the error of sensitive parameters by studying the parameters sensitivity can reduce the uncertainty of the model,while simulating double-gyre variation in Regional Ocean Modeling System(ROMS).Conditional Nonlinear Optimal Perturbation related to Parameter(CNOP-P)is an effective method of studying the parameters sensitivity,which represents a type of parameter error with maximum nonlinear development at the prediction time.Intelligent algorithms have been widely applied to solving Conditional Nonlinear Optimal Perturbation(CNOP).In the paper,we proposed an improved simulated annealing(SA)algorithm to solve CNOP-P to get the optimal parameters error,studied the sensitivity of the single parameter and the combination of multiple parameters and verified the effect of reducing the error of sensitive parameters on reducing the uncertainty of model simulation.Specifically,we firstly found the non-period oscillation of kinetic energy time series of double gyre variation,then extracted two transition periods,which are respectively from high energy to low energy and from low energy to high energy.For every transition period,three parameters,respectively wind amplitude(WD),viscosity coefficient(VC)and linear bottom drag coefficient(RDRG),were studied by CNOP-P solved with SA algorithm.Finally,for sensitive parameters,their effect on model simulation is verified.Experiments results showed that the sensitivity order is WD>VC>>RDRG,the effect of the combination of multiple sensitive parameters is greater than that of single parameter superposition and the reduction of error of sensitive parameters can effectively reduce model prediction error which confirmed the importance of sensitive parameters analysis.

A SVD-based ensemble projection algorithm for calculating the conditional nonlinear optimal perturbation

Conditional nonlinear optimal perturbation(CNOP) is an extension of the linear singular vector technique in the nonlinear regime.It represents the initial perturbation that is subjected to a given physical constraint,and results in the largest nonlinear evolution at the prediction time.CNOP-type errors play an important role in the predictability of weather and climate.Generally,when calculating CNOP in a complicated numerical model,we need the gradient of the objective function with respect to the initial perturbations to provide the descent direction for searching the phase space.The adjoint technique is widely used to calculate the gradient of the objective function.However,it is difficult and cumbersome to construct the adjoint model of a complicated numerical model,which imposes a limitation on the application of CNOP.Based on previous research,this study proposes a new ensemble projection algorithm based on singular vector decomposition(SVD).The new algorithm avoids the localization procedure of previous ensemble projection algorithms,and overcomes the uncertainty caused by choosing the localization radius empirically.The new algorithm is applied to calculate the CNOP in an intermediate forecasting model.The results show that the CNOP obtained by the new ensemble-based algorithm can effectively approximate that calculated by the adjoint algorithm,and retains the general spatial characteristics of the latter.Hence,the new SVD-based ensemble projection algorithm proposed in this study is an effective method of approximating the CNOP.