Application of the Conditional Nonlinear Optimal Perturbation Method to the Predictability Study of the Kuroshio Large Meander

A reduced-gravity barotropic shallow-water model was used to simulate the Kuroshio path variations. The results show that the model was able to capture the essential features of these path variations. We used one simulation of the model as the reference state and investigated the effects of errors in model parameters on the prediction of the transition to the Kuroshio large meander （KLM） state using the conditional nonlinear optimal parameter perturbation （CNOP-P） method. Because of their relatively large uncertainties, three model parameters were considered： the interracial friction coefficient, the wind-stress amplitude, and the lateral friction coefficient. We determined the CNOP-Ps optimized for each of these three parameters independently, and we optimized all three parameters simultaneously using the Spectral Projected Gradient 2 （SPG2） algorithm. Similarly, the impacts caused by errors in initial conditions were examined using the conditional nonlinear optimal initial perturbation （CNOP-I） method. Both the CNOP-I and CNOP-Ps can result in significant prediction errors of the KLM over a lead time of 240 days. But the prediction error caused by CNOP-I is greater than that caused by CNOP-P. The results of this study indicate not only that initial condition errors have greater effects on the prediction of the KLM than errors in model parameters but also that the latter cannot be ignored. Hence, to enhance the forecast skill of the KLM in this model, the initial conditions should first be improved, the model parameters should use the best possible estimates.

A New Strategy for Solving a Class of Constrained Nonlinear Optimization Problems Related to Weather and Climate Predictability

There are three common types of predictability problems in weather and climate, which each involve different constrained nonlinear optimization problems： the lower bound of maximum predictable time, the upper bound of maximum prediction error, and the lower bound of maximum allowable initial error and parameter error. Highly effcient algorithms have been developed to solve the second optimization problem. And this optimization problem can be used in realistic models for weather and climate to study the upper bound of the maximum prediction error. Although a filtering strategy has been adopted to solve the other two problems, direct solutions are very time-consuming even for a very simple model, which therefore limits the applicability of these two predictability problems in realistic models. In this paper, a new strategy is designed to solve these problems, involving the use of the existing highly effcient algorithms for the second predictability problem in particular. Furthermore, a series of comparisons between the older filtering strategy and the new method are performed. It is demonstrated that the new strategy not only outputs the same results as the old one, but is also more computationally effcient. This would suggest that it is possible to study the predictability problems associated with these two nonlinear optimization problems in realistic forecast models of weather or climate.

Inducing Unstable Grassland Equilibrium States Due to Nonlinear Optimal Patterns of Initial and Parameter Perturbations:Theoretical Models

Due to uncertainties in initial conditions and parameters, the stability and uncertainty of grassland ecosystem simulations using ecosystem models are issues of concern. Our objective is to determine the types and patterns of initial and parameter perturbations that yield the greatest instability and uncertainty in simulated grassland ecosystems using theoretical models. We used a nonlinear optimization approach, i.e., a conditional nonlinear optimal perturbation related to initial and parameter perturbations （CNOP） approach, in our work. Numerical results indicated that the CNOP showed a special and nonlinear optimal pattern when the initial state variables and multiple parameters were considered simultaneously. A visibly different complex optimal pattern characterizing the CNOPs was obtained by choosing different combinations of initial state variables and multiple parameters in different physical processes. We propose that the grassland modeled ecosystem caused by the CNOP-type perturbation is unstable and exhibits two aspects： abrupt change and the time needed for the abrupt change from a grassland equilibrium state to a desert equilibrium state when the initial state variables and multiple parameters are considered simultaneously. We compared these findings with results affected by the CNOPs obtained by considering only uncertainties in initial state variables and in a single parameter. The numerical results imply that the nonlinear optimal pattern of initial perturbations and parameter perturbations, especially for more parameters or when special parameters are involved, plays a key role in determining stabilities and uncertainties associated with a simulated or predicted grassland ecosystem.

A Variant Constrained Genetic Algorithm for Solving Conditional Nonlinear Optimal Perturbations

A variant constrained genetic algorithm （VCGA） for effective tracking of conditional nonlinear optimal perturbations （CNOPs） is presented. Compared with traditional constraint handling methods, the treatment of the constraint condition in VCGA is relatively easy to implement. Moreover, it does not require adjustments to indefinite pararneters. Using a hybrid crossover operator and the newly developed multi-ply mutation operator, VCGA improves the performance of GAs. To demonstrate the capability of VCGA to catch CNOPS in non-smooth cases, a partial differential equation, which has ＂on off＂ switches in its forcing term, is employed as the nonlinear model. To search global CNOPs of the nonlinear model, numerical experiments using VCGA, the traditional gradient descent algorithm based on the adjoint method （ADJ）, and a GA using tournament selection operation and the niching technique （GA-DEB） were performed. The results with various initial reference states showed that, in smooth cases, all three optimization methods are able to catch global CNOPs. Nevertheless, in non-smooth situations, a large proportion of CNOPs captured by the ADJ are local. Compared with ADJ, the performance of GA-DEB shows considerable improvement, but it is far below VCGA. Further, the impacts of population sizes on both VCGA and GA-DEB were investigated. The results were used to estimate the computation time of ~CGA and GA-DEB in obtaining CNOPs. The computational costs for VCGA, GA-DEB and ADJ to catch CNOPs of the nonlinear model are also compared.

Algorithm Studies on How to Obtain a Conditional Nonlinear Optimal Perturbation (CNOP)

The conditional nonlinear optimal perturbation （CNOP）, which is a nonlinear generalization of the linear singular vector （LSV）, is applied in important problems of atmospheric and oceanic sciences, including ENSO predictability, targeted observations, and ensemble forecast. In this study, we investigate the computational cost of obtaining the CNOP by several methods. Differences and similarities, in terms of the computational error and cost in obtaining the CNOP, are compared among the sequential quadratic programming （SQP） algorithm, the limited memory Broyden-Fletcher-Goldfarb-Shanno （L-BFGS） algorithm, and the spectral projected gradients （SPG2） algorithm. A theoretical grassland ecosystem model and the classical Lorenz model are used as examples. Numerical results demonstrate that the computational error is acceptable with all three algorithms. The computational cost to obtain the CNOP is reduced by using the SQP algorithm. The experimental results also reveal that the L-BFGS algorithm is the most effective algorithm among the three optimization algorithms for obtaining the CNOP. The numerical results suggest a new approach and algorithm for obtaining the CNOP for a large-scale optimization problem.

Application of the Conditional Nonlinear Optimal Perturbations Method in a Theoretical Grassland Ecosystem

Using a simplified nonlinearly theoretical grassland ecosystem proposed by Zeng et al.,we study the sensitivity and nonlinear instability of the grassland ecosystem to finiteamplitude initial perturbations with the approach of conditional nonlinear optimal perturbation （CNOP）.The results show that the linearly stable grassland （desert or latent desert） states can turn to be nonlinearly unstable with finite amplitude initial perturbations.When the precipitation is between the two bifurcation points,a large enough finite amplitude initial perturbation can induce a transition between the grassland statethe desert state or the latent desert.

Applications of Conditional Nonlinear Optimal Perturbation to the Study of the Stability and Sensitivity of the Jovian Atmosphere

A two-layer quasi-geostrophic model is used to study the stability and sensitivity of motions on smallscale vortices in Jupiter＇s atmosphere. Conditional nonlinear optimal perturbations （CNOPs） and linear singular vectors （LSVs） are both obtained numerically and compared in this paper. The results show that CNOPs can capture the nonlinear characteristics of motions in small-scale vortices in Jupiter＇s atmosphere and show great difference from LSVs under the condition that the initial constraint condition is large or the optimization time is not very short or both. Besides, in some basic states, local CNOPs are found. The pattern of LSV is more similar to local CNOP than global CNOP in some cases. The elementary application of the method of CNOP to the Jovian atmosphere helps us to explore the stability of variousscale motions of Jupiter＇s atmosphere and to compare the stability of motions in Jupiter＇s atmosphere and Earth＇s atmosphere further.

THE EFFECTIVENESS OF GENETIC ALGORITHM IN CAPTURING CONDITIONAL NONLINEAR OPTIMAL PERTURBATION WITH PARAMETERIZATION “ON-OFF” SWITCHES INCLUDED BY A MODEL

In the typhoon adaptive observation based on conditional nonlinear optimal perturbation (CNOP), the ‘on-off’ switch caused by moist physical parameterization in prediction models prevents the conventional adjoint method from providing correct gradient during the optimization process. To address this problem, the capture of CNOP, when the "on-off" switches are included in models, is treated as non-smooth optimization in this study, and the genetic algorithm (GA) is introduced. After detailed algorithm procedures are formulated using an idealized model with parameterization "on-off" switches in the forcing term, the impacts of "on-off" switches on the capture of CNOP are analyzed, and three numerical experiments are conducted to check the effectiveness of GA in capturing CNOP and to analyze the impacts of different initial populations on the optimization result. The result shows that GA is competent for the capture of CNOP in the context of the idealized model with parameterization ‘on-off’ switches in this study. Finally, the advantages and disadvantages of GA in capturing CNOP are analyzed in detail.

THE APPLICATION OF CONDITIONAL NONLINEAR OPTIMAL PERTURBATION TO THE BINARY TYPHOONS INTERACTION —FENGSHEN AND FUNG-WONG

The interaction between the typhoons Fengshen and Fung-wong over the Western Pacific in 2002 is studied with the Conditional Nonlinear Optimal Perturbation(CNOP) method.The study discovered that the CNOP method reveals the process of one-way interaction between Fengshen and Fung-wong.Moreover,if the region of Fung-wong was selected for verification,the sensitivity area was mainly located in the region of Fengshen and presented a half-ring structure;if the region of Fengshen was selected for verification,most of the sensitivity areas were located in the region between the Fengshen and the subtropical high,far away from Fung-wong.This indicated that Fung-wong is mainly steered by Fengshen,but Fengshen is mainly affected by the subtropical high.The sensitivity experiment showed that the initial errors in the CNOP-identified sensitive areas have larger impacts on the verification-area prediction than those near the typhoon center and their developments take a large proportion in the whole domain.This suggests that the CNOP-identified sensitive areas do have large influence on the verification-area prediction.

Ensemble Forecasts of Tropical Cyclone Track with Orthogonal Conditional Nonlinear Optimal Perturbations

This paper preliminarily investigates the application of the orthogonal conditional nonlinear optimal perturbations(CNOPs)–based ensemble forecast technique in MM5(Fifth-generation Pennsylvania State University–National Center for Atmospheric Research Mesoscale Model). The results show that the ensemble forecast members generated by the orthogonal CNOPs present large spreads but tend to be located on the two sides of real tropical cyclone(TC) tracks and have good agreements between ensemble spreads and ensemble-mean forecast errors for TC tracks. Subsequently, these members reflect more reasonable forecast uncertainties and enhance the orthogonal CNOPs–based ensemble-mean forecasts to obtain higher skill for TC tracks than the orthogonal SVs(singular vectors)–, BVs(bred vectors)– and RPs(random perturbations)–based ones. The results indicate that orthogonal CNOPs of smaller magnitudes should be adopted to construct the initial ensemble perturbations for short lead–time forecasts, but those of larger magnitudes should be used for longer lead–time forecasts due to the effects of nonlinearities. The performance of the orthogonal CNOPs–based ensemble-mean forecasts is case-dependent,which encourages evaluating statistically the forecast skill with more TC cases. Finally, the results show that the ensemble forecasts with only initial perturbations in this work do not increase the forecast skill of TC intensity, which may be related with both the coarse model horizontal resolution and the model error.

APPLICATIONS OF NONLINEAR OPTIMIZATION METHODTO NUMERICAL STUDIES OF ATMOSPHERICAND OCEANIC SCIENCES

Linear singular vector and linear singular value can only describe the evolution of sufficiently small perturbations during the period in which the tangent linear model is valid. With this in mind,the applications of nonlinear optimization methods to the atmospheric and oceanic sciences are introduced, which include nonlinear singular vector (NSV) and nonlinear singular value (NSVA), conditional nonlinear optimal perturbation (CNOP), and their applications to the studies of predictability in numerical weather and climate prediction. The results suggest that the nonlinear characteristics of the motions of atmosphere and oceans can be explored by NSV and CNOP. Also attentions are paid to the introduction of the classification of predictability problems, which are related to the maximum predictable time, the maximum prediction error, and the maximum allowing error of initial value and the parameters. All the information has the background of application to the evaluation of products of numerical weather and climate prediction. Furthermore the nonlinear optimization methods of the sensitivity analysis with numerical model are also introduced, which can give a quantitative assessment whether a numerical model is able to simulate the observations and find the initial field that yield the optimal simulation. Finally, the difficulties in the lack of ripe algorithms are also discussed, which leave future work to both computational mathematics and scientists in geophysics.

A new approach to studying ENSO predictability:Conditional nonlinear optimal perturbation

A new approach, the conditional nonlinear optimal perturbation (CNOP) is introduced to study the predictability of El Ni駉-Southern Oscillation (ENSO) using a theoretical coupled ocean-atmosphere model. The differences between CNOP and linear singular vector (LSV) are demonstrated. The results suggest that the nonlinear model and CNOP are superior in determining error growth for studying predictability of the ENSO. In particular, the CNOP approach is used to explore the nature of the 憇pring predictability barrier?in ENSO prediction.

Conditional nonlinear optimal perturbation and its applications to the studies of weather and climate predictability

Conditional nonlinear optimal perturbation (CNOP) is the initial perturbation that has the largest nonlinear evolution at prediction time for initial perturba-tions satisfying certain physical constraint condition. It does not only represent the optimal precursor of certain weather or climate event, but also stand for the initial error which has largest effect on the prediction uncertainties at the prediction time. In sensitivity and stability analyses of fluid motion, CNOP also describes the most unstable (or most sensitive) mode. CNOP has been used to estimate the upper bound of the prediction error. These physical characteristics of CNOP are examined by applying respectively them to ENSO pre-dictability studies and ocean’s thermohaline circulation (THC) sensitivity analysis. In ENSO predictability studies, CNOP, rather than linear singular vector (LSV), represents the initial patterns that evolve into ENSO events most poten-tially, i.e. the optimal precursors for ENSO events. When initial perturbation is considered to be the initial error of ENSO, CNOP plays the role of the initial error that has larg-est effect on the prediction of ENSO. CNOP also derives the upper bound of prediction error of ENSO events. In the THC sensitivity and stability studies, by calculating the CNOP (most unstable perturbation) of THC, it is found that there is an asymmetric nonlinear response of ocean’s THC to the finite amplitude perturbations. Finally, attention is paid to the feasibility of CNOP in more complicated model. It is shown that in a model with higher dimensions, CNOP can be computed successfully. The corresponding optimization algo-rithm is also shown to be efficient.

On the Application of a Genetic Algorithm to the Predictability Problems Involving "On-Off" Switches

The lower bound of maximum predictable time can be formulated into a constrained nonlinear opti- mization problem, and the traditional solutions to this problem are the filtering method and the conditional nonlinear optimal perturbation （CNOP） method. Usually, the CNOP method is implemented with the help of a gradient descent algorithm based on the adjoint method, which is named the ADJ-CNOP. However, with the increasing improvement of actual prediction models, more and more physical processes are taken into consideration in models in the form of parameterization, thus giving rise to the on–off switch problem, which tremendously affects the effectiveness of the conventional gradient descent algorithm based on the ad- joint method. In this study, we attempted to apply a genetic algorithm （GA） to the CNOP method, named GA-CNOP, to solve the predictability problems involving on–off switches. As the precision of the filtering method depends uniquely on the division of the constraint region, its results were taken as benchmarks, and a series of comparisons between the ADJ-CNOP and the GA-CNOP were performed for the modified Lorenz equation. Results show that the GA-CNOP can always determine the accurate lower bound of maximum predictable time, even in non-smooth cases, while the ADJ-CNOP, owing to the effect of on–off switches, often yields the incorrect lower bound of maximum predictable time. Therefore, in non-smooth cases, using GAs to solve predictability problems is more effective than using the conventional optimization algorithm based on gradients, as long as genetic operators in GAs are properly configured.

Impact of observational MJO forcing on ENSO predictability in the Zebiak-Cane model: PartⅠ.Effect on the maximum prediction error

With the observational wind data and the Zebiak-Cane model, the impact of Madden-Iulian Oscillation （MJO） as external forcing on El Nino-Southern Oscillation （ENSO） predictability is studied. The observational data are analyzed with Continuous Wavelet Transform （CWT） and then used to extract MJO signals, which are added into the model to get a new model. After the Conditional Nonlinear Optimal Perturbation （CNOP） method has been used, the initial errors which can evolve into maximum prediction error, model errors and their join errors are gained and then the Nifio 3 indices and spatial structures of three kinds of errors are investigated. The results mainly show that the observational MJO has little impact on the maximum prediction error of ENSO events and the initial error affects much greater than model error caused by MJO forcing. These demonstrate that the initial error might be the main error source that produces uncertainty in ENSO prediction, which could provide a theoretical foundation for the adaptive data assimilation of the ENSO forecast and contribute to the ENSO target observation.

Effect of Stochastic MJO Forcing on ENSO Predictability

Within the frame of the Zebiak-Cane model,the impact of the uncertainties of the Madden-Julian Oscillation（MJO） on ENSO predictability was studied using a parameterized stochastic representation of intraseasonal forcing.The results show that the uncertainties of MJO have little effect on the maximum prediction error for ENSO events caused by conditional nonlinear optimal perturbation（CNOP）;compared to CNOP-type initial error,the model error caused by the uncertainties of MJO led to a smaller prediction uncertainty of ENSO,and its influence over the ENSO predictability was not significant.This result suggests that the initial error might be the main error source that produces uncertainty in ENSO prediction,which could provide a theoretical foundation for the data assimilation of the ENSO forecast.

Application of Conditional Nonlinear Optimal Perturbation to Targeted Observation Studies of the Atmosphere and Ocean

This paper reviews progress in the application of conditional nonlinear optimal perturbation to targeted observation studies of the atmosphere and ocean in recent years, with a focus on the E1 Nifio-Southern Oscillation （ENSO）, Kuroshio path variations, and blocking events. Through studying the optimal precursor （OPR） and optimally growing initial error （OGE） of the occurrence of the above events, the similarity and localization features of OPR and OGE spatial structures have been found for each event. Ideal hindcasting experiments have shown that, if initial errors are reduced in the areas with the largest amplitude for the OPR and OGE for ENSO and Kuroshio path variations, the forecast skill of the model for these events is significantly improved. Due to the similarity between patterns of the OPR and OGE, additional observations implemented in the same sensitive region would help to not only capture the precursors, but also reduce the initial errors in the predictions, greatly increasing the forecast abilities. The similarity and localization of the spatial structures of the OPR and OGE during the onset of blocking events have also been investigated, but their application to targeted observation requires further study.

A SVD-based ensemble projection algorithm for calculating the conditional nonlinear optimal perturbation

Conditional nonlinear optimal perturbation(CNOP) is an extension of the linear singular vector technique in the nonlinear regime.It represents the initial perturbation that is subjected to a given physical constraint,and results in the largest nonlinear evolution at the prediction time.CNOP-type errors play an important role in the predictability of weather and climate.Generally,when calculating CNOP in a complicated numerical model,we need the gradient of the objective function with respect to the initial perturbations to provide the descent direction for searching the phase space.The adjoint technique is widely used to calculate the gradient of the objective function.However,it is difficult and cumbersome to construct the adjoint model of a complicated numerical model,which imposes a limitation on the application of CNOP.Based on previous research,this study proposes a new ensemble projection algorithm based on singular vector decomposition(SVD).The new algorithm avoids the localization procedure of previous ensemble projection algorithms,and overcomes the uncertainty caused by choosing the localization radius empirically.The new algorithm is applied to calculate the CNOP in an intermediate forecasting model.The results show that the CNOP obtained by the new ensemble-based algorithm can effectively approximate that calculated by the adjoint algorithm,and retains the general spatial characteristics of the latter.Hence,the new SVD-based ensemble projection algorithm proposed in this study is an effective method of approximating the CNOP.

A study of parameter uncertainties causing uncertainties in modeling a grassland ecosystem using the conditional nonlinear optimal perturbation method

In this paper, we apply the approach of conditional nonlinear optimal perturbation related to the parameter(CNOP-P)to study parameter uncertainties that lead to the stability(maintenance or degradation) of a grassland ecosystem. The maintenance of the grassland ecosystem refers to the unchanged or increased quantity of living biomass and wilted biomass in the ecosystem,and the degradation of the grassland ecosystem refers to the reduction in the quantity of living biomass and wilted biomass or its transformation into a desert ecosystem. Based on a theoretical five-variable grassland ecosystem model, 32 physical model parameters are selected for numerical experiments. Two types of parameter uncertainties could be obtained. The first type of parameter uncertainty is the linear combination of each parameter uncertainty that is computed using the CNOP-P method. The second type is the parameter uncertainty from multi-parameter optimization using the CNOP-P method. The results show that for the 32 model parameters, at a given optimization time and with greater parameter uncertainty, the patterns of the two types of parameter uncertainties are different. The different patterns represent physical processes of soil wetness. This implies that the variations in soil wetness(surface layer and root zone) are the primary reasons for uncertainty in the maintenance or degradation of grassland ecosystems, especially for the soil moisture of the surface layer. The above results show that the CNOP-P method is a useful tool for discussing the abovementioned problems.

Recent Progress in Applications of the Conditional Nonlinear Optimal Perturbation Approach to Atmosphere-Ocean Sciences

The conditional nonlinear optimal perturbation(CNOP for short) approach is a powerful tool for predictability and targeted observation studies in atmosphere-ocean sciences. By fully considering nonlinearity under appropriate physical constraints, the CNOP approach can reveal the optimal perturbations of initial conditions, boundary conditions, model parameters, and model tendencies that cause the largest simulation or prediction uncertainties. This paper reviews the progress of applying the CNOP approach to atmosphere-ocean sciences during the past five years. Following an introduction of the CNOP approach, the algorithm developments for solving the CNOP are discussed.Then, recent CNOP applications, including predictability studies of some high-impact ocean-atmospheric environmental events, ensemble forecast, parameter sensitivity analysis, uncertainty estimation caused by errors of model tendency or boundary condition, are reviewed. Finally, a summary and discussion on future applications and challenges of the CNOP approach are presented.