The existence of outliers can seriously influence the analysis of variational data assimilation.Quality control allows us to effectively eliminate or absorb these outliers to produce better analysis fields.In particul...The existence of outliers can seriously influence the analysis of variational data assimilation.Quality control allows us to effectively eliminate or absorb these outliers to produce better analysis fields.In particular,variational quality control(VarQC) can process gray zone outliers and is thus broadly used in variational data assimilation systems.In this study,governing equations are derived for two VarQC algorithms that utilize different contaminated Gaussian distributions(CGDs): Gaussian plus flat distribution and Huber norm distribution.As such,these VarQC algorithms can handle outliers that have non-Gaussian innovations.Then,these VarQC algorithms are implemented in the Global/Regional Assimilation and PrEdiction System(GRAPES) model-level three-dimensional variational data assimilation(m3 DVAR) system.Tests using artificial observations indicate that the VarQC method using the Huber distribution has stronger robustness for including outliers to improve posterior analysis than the VarQC method using the Gaussian plus flat distribution.Furthermore,real observation experiments show that the distribution of observation analysis weights conform well with theory,indicating that the application of VarQC is effective in the GRAPES m3 DVAR system.Subsequent case study and longperiod data assimilation experiments show that the spatial distribution and amplitude of the observation analysis weights are related to the analysis increments of the mass field(geopotential height and temperature).Compared to the control experiment,VarQC experiments have noticeably better posterior mass fields.Finally,the VarQC method using the Huber distribution is superior to the VarQC method using the Gaussian plus flat distribution,especially at the middle and lower levels.展开更多
The magnitude and distribution of observation innovations,which have an important impact on the analyzed accuracy,are critical variables in data assimilation.Variational quality control(VarQC)based on the contaminated...The magnitude and distribution of observation innovations,which have an important impact on the analyzed accuracy,are critical variables in data assimilation.Variational quality control(VarQC)based on the contaminated Gaussian distribution(CGD)of observation innovations is now widely used in data assimilation,owing to the more reasonable representation of the probability density function of innovations that can sufficiently absorb observations by assigning different weights iteratively.However,the inaccurate parameters prevent VarQC from showing the advantages it should have in the GRAPES(Global/Regional Assimilation and PrEdiction System)m3DVAR system.Consequently,the parameter optimization methods are considerable critical studies to improve VarQC.In this paper,we describe two probable CGDs to include the non-Gaussian distribution of actual observation errors,Gaussian plus flat distribution and Huber norm distribution.The potential optimization methods of the parameters are introduced in detail for different VarQCs.With different parameter configurations,the optimization analysis shows that the Gaussian plus flat distribution and the Huber norm distribution are more consistent with the long-tail distribution of actual innovations compared to the Gaussian distribution.The VarQC’s cost and gradient functions with Huber norm distribution are more reasonable,while the VarQC’s cost function with Gaussian plus flat distribution may converge on different minimums due to its nonconcave properties.The weight functions of two VarQCs gradually decrease with the increase of innovation but show different shapes,and the VarQC with Huber norm distribution shows more elasticity to assimilate the observations with a high contamination rate.Moreover,we reveal a general derivation relationship between the CGDs and VarQCs.A novel schematic interpretation that classifies the assimilated data into three categories in VarQC is presented.They are conducive to the development of a new VarQC method in the future.展开更多
A class of networked control systems is investigated whose communication network is shared with other applications. The design objective for such a system setting is not only the optimization of the control performanc...A class of networked control systems is investigated whose communication network is shared with other applications. The design objective for such a system setting is not only the optimization of the control performance but also the efficient utilization of the communication resources. We observe that at a large time scale the data packet delay in the communication network is roughly varying piecewise constant, which is typically true for data networks like the Internet. Based on this observation, a dynamic data packing scheme is proposed within the recently developed packet-based control framework for networked control systems. As expected this proposed approach achieves a fine balance between the control performance and the communication utilization: the similar control performance can be obtained at dramatically reduced cost of the communication resources. Simulations illustrate the effectiveness of the proposed approach.展开更多
基金supported by the China Scholarship Councilprimarily sponsored by the National Key R&D Program of China (Grant No.2018YFC1506702 and Grant No.2017YFC1502000)。
文摘The existence of outliers can seriously influence the analysis of variational data assimilation.Quality control allows us to effectively eliminate or absorb these outliers to produce better analysis fields.In particular,variational quality control(VarQC) can process gray zone outliers and is thus broadly used in variational data assimilation systems.In this study,governing equations are derived for two VarQC algorithms that utilize different contaminated Gaussian distributions(CGDs): Gaussian plus flat distribution and Huber norm distribution.As such,these VarQC algorithms can handle outliers that have non-Gaussian innovations.Then,these VarQC algorithms are implemented in the Global/Regional Assimilation and PrEdiction System(GRAPES) model-level three-dimensional variational data assimilation(m3 DVAR) system.Tests using artificial observations indicate that the VarQC method using the Huber distribution has stronger robustness for including outliers to improve posterior analysis than the VarQC method using the Gaussian plus flat distribution.Furthermore,real observation experiments show that the distribution of observation analysis weights conform well with theory,indicating that the application of VarQC is effective in the GRAPES m3 DVAR system.Subsequent case study and longperiod data assimilation experiments show that the spatial distribution and amplitude of the observation analysis weights are related to the analysis increments of the mass field(geopotential height and temperature).Compared to the control experiment,VarQC experiments have noticeably better posterior mass fields.Finally,the VarQC method using the Huber distribution is superior to the VarQC method using the Gaussian plus flat distribution,especially at the middle and lower levels.
基金sponsored by the National Key R&D Program of China(Nos.2018YFC1506702 and 2017YFC1502000).
文摘The magnitude and distribution of observation innovations,which have an important impact on the analyzed accuracy,are critical variables in data assimilation.Variational quality control(VarQC)based on the contaminated Gaussian distribution(CGD)of observation innovations is now widely used in data assimilation,owing to the more reasonable representation of the probability density function of innovations that can sufficiently absorb observations by assigning different weights iteratively.However,the inaccurate parameters prevent VarQC from showing the advantages it should have in the GRAPES(Global/Regional Assimilation and PrEdiction System)m3DVAR system.Consequently,the parameter optimization methods are considerable critical studies to improve VarQC.In this paper,we describe two probable CGDs to include the non-Gaussian distribution of actual observation errors,Gaussian plus flat distribution and Huber norm distribution.The potential optimization methods of the parameters are introduced in detail for different VarQCs.With different parameter configurations,the optimization analysis shows that the Gaussian plus flat distribution and the Huber norm distribution are more consistent with the long-tail distribution of actual innovations compared to the Gaussian distribution.The VarQC’s cost and gradient functions with Huber norm distribution are more reasonable,while the VarQC’s cost function with Gaussian plus flat distribution may converge on different minimums due to its nonconcave properties.The weight functions of two VarQCs gradually decrease with the increase of innovation but show different shapes,and the VarQC with Huber norm distribution shows more elasticity to assimilate the observations with a high contamination rate.Moreover,we reveal a general derivation relationship between the CGDs and VarQCs.A novel schematic interpretation that classifies the assimilated data into three categories in VarQC is presented.They are conducive to the development of a new VarQC method in the future.
基金supported by the National Natural Science Foundation of China(Grant Nos.6142230761174061&61304048)+4 种基金the Scientific Research Starting Foundation for the Returned Overseas Chinese Scholars,Ministry of Education of Chinathe National Hi-Tech Research and Development Program of China("863"Project)(Grant No.2014AA06A503)the Youth Innovation Promotion Association,Chinese Academy of Sciences,in part by the Youth Top-Notch Talent Support Programthe 1000-Talent Youth ProgramZhejiang 1000-Talent Program
文摘A class of networked control systems is investigated whose communication network is shared with other applications. The design objective for such a system setting is not only the optimization of the control performance but also the efficient utilization of the communication resources. We observe that at a large time scale the data packet delay in the communication network is roughly varying piecewise constant, which is typically true for data networks like the Internet. Based on this observation, a dynamic data packing scheme is proposed within the recently developed packet-based control framework for networked control systems. As expected this proposed approach achieves a fine balance between the control performance and the communication utilization: the similar control performance can be obtained at dramatically reduced cost of the communication resources. Simulations illustrate the effectiveness of the proposed approach.