Weighted total least squares(WTLS)have been regarded as the standard tool for the errors-in-variables(EIV)model in which all the elements in the observation vector and the coefficient matrix are contaminated with rand...Weighted total least squares(WTLS)have been regarded as the standard tool for the errors-in-variables(EIV)model in which all the elements in the observation vector and the coefficient matrix are contaminated with random errors.However,in many geodetic applications,some elements are error-free and some random observations appear repeatedly in different positions in the augmented coefficient matrix.It is called the linear structured EIV(LSEIV)model.Two kinds of methods are proposed for the LSEIV model from functional and stochastic modifications.On the one hand,the functional part of the LSEIV model is modified into the errors-in-observations(EIO)model.On the other hand,the stochastic model is modified by applying the Moore-Penrose inverse of the cofactor matrix.The algorithms are derived through the Lagrange multipliers method and linear approximation.The estimation principles and iterative formula of the parameters are proven to be consistent.The first-order approximate variance-covariance matrix(VCM)of the parameters is also derived.A numerical example is given to compare the performances of our proposed three algorithms with the STLS approach.Afterwards,the least squares(LS),total least squares(TLS)and linear structured weighted total least squares(LSWTLS)solutions are compared and the accuracy evaluation formula is proven to be feasible and effective.Finally,the LSWTLS is applied to the field of deformation analysis,which yields a better result than the traditional LS and TLS estimations.展开更多
The linear coupling of Non-gyro Micro Inertial Measurement Unit (NGMIMU) is akind of system error that affects the accuracy of measurement seriously. In this article, theauthor puts forward a new linear decoupling alg...The linear coupling of Non-gyro Micro Inertial Measurement Unit (NGMIMU) is akind of system error that affects the accuracy of measurement seriously. In this article, theauthor puts forward a new linear decoupling algorithm which simultaneously considers the error ofstandard input signal and output of accelerators when the coupling parameters are calculated. TheTotal Least Square (TLS) solutions of coupling parameters own the minimum characteristic to theinput and output values. Then these parameters are used to reconstruct the outputs of acceleratorsso as to realize the decoupling. The emulation result show that the ratio of decoupling error isless than 8 percent and verify the feasibility of this algorithm.展开更多
Through theoretical derivation, some properties of the total least squares estimation are found. The total least squares estimation is the linear transformation of the least squares estimation, and the total least squ...Through theoretical derivation, some properties of the total least squares estimation are found. The total least squares estimation is the linear transformation of the least squares estimation, and the total least squares estimation is unbiased. The condition number of the total least squares estimation is greater than the least squares estimation, so the total least squares estimation is easier to be affected by the data error than the least squares estimation. Then through the further derivation, the relationships of solutions, residuals and unit weight variance estimations between the total least squares and the least squares are given.展开更多
A new model considering corrosion property for grounding grids diagnosis is proposed,which provides reference solutions of ambiguous branches.The constraint total least square method based on singular value decomposit...A new model considering corrosion property for grounding grids diagnosis is proposed,which provides reference solutions of ambiguous branches.The constraint total least square method based on singular value decomposition is adopted to improve the effectiveness of grounding grids' diagnosis algorithm.The improvement can weaken the influence of the model's error,which results from the differences between design paper and actual grid.Its influence on touch and step voltages caused by the interior resistance of conductors is taken into account.Simulation results show the validity of this approach.展开更多
A novel multi-observer passive localization algorithm based on the weighted restricted total least square (WRTLS) is proposed to solve the bearings-only localization problem in the presence of observer position erro...A novel multi-observer passive localization algorithm based on the weighted restricted total least square (WRTLS) is proposed to solve the bearings-only localization problem in the presence of observer position errors. Firstly, the unknown matrix perturbation information is utilized to form the WRTLS problem. Then, the corresponding constrained optimization problem is transformed into an unconstrained one, which is a generalized Rayleigh quotient minimization problem. Thus, the solution can be got through the generalized eigenvalue decomposition and requires no initial state guess process. Simulation results indicate that the proposed algorithm can approach the Cramer-Rao lower bound (CRLB), and the localization solution is asymptotically unbiased.展开更多
Consider solving an overdetermined system of linear algebraic equations by both the least squares method (LS) and the total least squares method (TLS). Extensive published computational evidence shows that when the or...Consider solving an overdetermined system of linear algebraic equations by both the least squares method (LS) and the total least squares method (TLS). Extensive published computational evidence shows that when the original system is consistent. one often obtains more accurate solutions by using the TLS method rather than the LS method. These numerical observations contrast with existing analytic perturbation theories for the LS and TLS methods which show that the upper bounds for the LS solution are always smaller than the corresponding upper bounds for the TLS solutions. In this paper we derive a new upper bound for the TLS solution and indicate when the TLS method can be more accurate than the LS method.Many applied problems in signal processing lead to overdetermined systems of linear equations where the matrix and right hand side are determined by the experimental observations (usually in the form of a lime series). It often happens that as the number of columns of the matrix becomes larger, the展开更多
When the total least squares(TLS)solution is used to solve the parameters in the errors-in-variables(EIV)model,the obtained parameter estimations will be unreliable in the observations containing systematic errors.To ...When the total least squares(TLS)solution is used to solve the parameters in the errors-in-variables(EIV)model,the obtained parameter estimations will be unreliable in the observations containing systematic errors.To solve this problem,we propose to add the nonparametric part(systematic errors)to the partial EIV model,and build the partial EIV model to weaken the influence of systematic errors.Then,having rewritten the model as a nonlinear model,we derive the formula of parameter estimations based on the penalized total least squares criterion.Furthermore,based on the second-order approximation method of precision estimation,we derive the second-order bias and covariance of parameter estimations and calculate the mean square error(MSE).Aiming at the selection of the smoothing factor,we propose to use the U curve method.The experiments show that the proposed method can mitigate the influence of systematic errors to a certain extent compared with the traditional method and get more reliable parameter estimations and its precision information,which validates the feasibility and effectiveness of the proposed method.展开更多
The solution of the grey model(GM(1,1)model)generally involves equal-precision observations,and the(co)variance matrix is established from the prior information.However,the data are generally available with unequal-pr...The solution of the grey model(GM(1,1)model)generally involves equal-precision observations,and the(co)variance matrix is established from the prior information.However,the data are generally available with unequal-precision measurements in reality.To deal with the errors of all observations for GM(1,1)model with errors-in-variables(EIV)structure,we exploit the total least-squares(TLS)algorithm to estimate the parameters of GM(1,1)model in this paper.Ignoring that the effect of the improper prior stochastic model and the homologous observations may degrade the accuracy of parameter estimation,we further present a nonlinear total least-squares variance component estimation approach for GM(1,1)model,which resorts to the minimum norm quadratic unbiased estimation(MINQUE).The practical and simulative experiments indicate that the presented approach has significant merits in improving the predictive accuracy in comparison with control methods.展开更多
In classical regression analysis, the error of independent variable is usually not taken into account in regression analysis. This paper presents two solution methods for the case that both the independent and the dep...In classical regression analysis, the error of independent variable is usually not taken into account in regression analysis. This paper presents two solution methods for the case that both the independent and the dependent variables have errors. These methods are derived from the condition-adjustment and indirect-adjustment models based on the Total-Least-Squares principle. The equivalence of these two methods is also proven in theory.展开更多
A novel algorithm for source location by utilizing the time difference of arrival (TDOA) measurements of a signal received at spatially separated sensors is proposed. The algorithm is based on quadratic constraint tot...A novel algorithm for source location by utilizing the time difference of arrival (TDOA) measurements of a signal received at spatially separated sensors is proposed. The algorithm is based on quadratic constraint total least-squares (QC-TLS) method and gives an explicit solution. The total least-squares method is a generalized data fitting method that is appropriate for cases when the system model contains error or is not known exactly, and quadratic constraint, which could be realized via Lagrange multipliers technique, could constrain the solution to the location equations to improve location accuracy. Comparisons of performance with ordinary least-squares are made, and Monte Carlo simulations are performed. Simulation results indicate that the proposed algorithm has high location accuracy and achieves accuracy close to the Cramer-Rao lower bound (CRLB) near the small TDOA measurement error region.展开更多
A functional model named EIO(Errors-In-Observations) is proposed for general TLS(total least-squares)adjustment. The EIO model only considers the correction of the observation vector, but doesn't consider to corre...A functional model named EIO(Errors-In-Observations) is proposed for general TLS(total least-squares)adjustment. The EIO model only considers the correction of the observation vector, but doesn't consider to correct all elements in the design matrix as the EIV(Errors-In-Variables) model does, furthermore, the dimension of cofactor matrix is much smaller. Iterative algorithms for the parameter estimation and their precise covariance matrix are derived rigorously, and the computation steps are also presented. The proposed approach considers the correction of the observations in the coefficient matrix, and ensures their agreements in every matrix elements. Parameters and corrections can be solved at the same time.An approximate solution and a precise solution of the covariance matrix can be achieved by corresponding algorithms. Applications of EIO model and the proposed algorithms are demonstrated with several examples. The results and comparative studies show that the proposed EIO model and algorithms are feasible and reliable for general adjustment problems.展开更多
In this paper, we extend matrix scaled total least squares (MSTLS) problem with a single right-hand side to the case of multiple right-hand sides. Firstly, under some mild conditions, this paper gives an explicit expr...In this paper, we extend matrix scaled total least squares (MSTLS) problem with a single right-hand side to the case of multiple right-hand sides. Firstly, under some mild conditions, this paper gives an explicit expression of the minimum norm solution of MSTLS problem with multiple right-hand sides. Then, we present the Kronecker-product-based formulae for the normwise, mixed and componentwise condition numbers of the MSTLS problem. For easy estimation, we also exhibit Kronecker-product-free upper bounds for these condition numbers. All these results can reduce to those of the total least squares (TLS) problem which were given by Zheng <em>et al</em>. Finally, two numerical experiments are performed to illustrate our results.展开更多
超声医学成像因非侵入式、成本低且实时性好而被广泛应用。超声波动方程具有严重的离散不适定问题,迭代化与正则化结合可以解决这一问题,但重建图像质量较差。为解决这一问题,本文在矩量法基础上,引入Tikhonov-Gaussian方法中的滤波因子...超声医学成像因非侵入式、成本低且实时性好而被广泛应用。超声波动方程具有严重的离散不适定问题,迭代化与正则化结合可以解决这一问题,但重建图像质量较差。为解决这一问题,本文在矩量法基础上,引入Tikhonov-Gaussian方法中的滤波因子,用于校正较小奇异值,将复杂的不适定问题转化为容易求解的最小二乘问题,重构出高质量图像。通过实验数据分析,改进后的截断完全最小二乘算法(truncated total least squares,TTLS)重建质量更高,效果更好,相对误差降低了1.16201%,峰值信噪比提高了0.29132%,信噪比提高了3.0269%,结构相似性提高了1.72531%,图像对比度提高了14.21319%。展开更多
基金the financial support of the National Natural Science Foundation of China(Grant No.42074016,42104025,42274057and 41704007)Hunan Provincial Natural Science Foundation of China(Grant No.2021JJ30244)Scientific Research Fund of Hunan Provincial Education Department(Grant No.22B0496)。
文摘Weighted total least squares(WTLS)have been regarded as the standard tool for the errors-in-variables(EIV)model in which all the elements in the observation vector and the coefficient matrix are contaminated with random errors.However,in many geodetic applications,some elements are error-free and some random observations appear repeatedly in different positions in the augmented coefficient matrix.It is called the linear structured EIV(LSEIV)model.Two kinds of methods are proposed for the LSEIV model from functional and stochastic modifications.On the one hand,the functional part of the LSEIV model is modified into the errors-in-observations(EIO)model.On the other hand,the stochastic model is modified by applying the Moore-Penrose inverse of the cofactor matrix.The algorithms are derived through the Lagrange multipliers method and linear approximation.The estimation principles and iterative formula of the parameters are proven to be consistent.The first-order approximate variance-covariance matrix(VCM)of the parameters is also derived.A numerical example is given to compare the performances of our proposed three algorithms with the STLS approach.Afterwards,the least squares(LS),total least squares(TLS)and linear structured weighted total least squares(LSWTLS)solutions are compared and the accuracy evaluation formula is proven to be feasible and effective.Finally,the LSWTLS is applied to the field of deformation analysis,which yields a better result than the traditional LS and TLS estimations.
文摘The linear coupling of Non-gyro Micro Inertial Measurement Unit (NGMIMU) is akind of system error that affects the accuracy of measurement seriously. In this article, theauthor puts forward a new linear decoupling algorithm which simultaneously considers the error ofstandard input signal and output of accelerators when the coupling parameters are calculated. TheTotal Least Square (TLS) solutions of coupling parameters own the minimum characteristic to theinput and output values. Then these parameters are used to reconstruct the outputs of acceleratorsso as to realize the decoupling. The emulation result show that the ratio of decoupling error isless than 8 percent and verify the feasibility of this algorithm.
基金The research was supported by the National Natural Science Foundation of China(41204003)Scientific Research Foundation of ECIT(DHBK201113)Scientific Research Foundation of Jiangxi Province Key Laboratory for Digital Land(DLLJ201207)
文摘Through theoretical derivation, some properties of the total least squares estimation are found. The total least squares estimation is the linear transformation of the least squares estimation, and the total least squares estimation is unbiased. The condition number of the total least squares estimation is greater than the least squares estimation, so the total least squares estimation is easier to be affected by the data error than the least squares estimation. Then through the further derivation, the relationships of solutions, residuals and unit weight variance estimations between the total least squares and the least squares are given.
文摘A new model considering corrosion property for grounding grids diagnosis is proposed,which provides reference solutions of ambiguous branches.The constraint total least square method based on singular value decomposition is adopted to improve the effectiveness of grounding grids' diagnosis algorithm.The improvement can weaken the influence of the model's error,which results from the differences between design paper and actual grid.Its influence on touch and step voltages caused by the interior resistance of conductors is taken into account.Simulation results show the validity of this approach.
基金supported by the Aeronautical Science Foundation of China (20105584004)the Science and Technology on Avionics Integration Laboratory
文摘A novel multi-observer passive localization algorithm based on the weighted restricted total least square (WRTLS) is proposed to solve the bearings-only localization problem in the presence of observer position errors. Firstly, the unknown matrix perturbation information is utilized to form the WRTLS problem. Then, the corresponding constrained optimization problem is transformed into an unconstrained one, which is a generalized Rayleigh quotient minimization problem. Thus, the solution can be got through the generalized eigenvalue decomposition and requires no initial state guess process. Simulation results indicate that the proposed algorithm can approach the Cramer-Rao lower bound (CRLB), and the localization solution is asymptotically unbiased.
基金This author was supported by the National Natural Sciences Foundation,PRC. This author was supported by the Air Force Office of Scientific Research, USA, Grant No. AFOSR-91-0309
文摘Consider solving an overdetermined system of linear algebraic equations by both the least squares method (LS) and the total least squares method (TLS). Extensive published computational evidence shows that when the original system is consistent. one often obtains more accurate solutions by using the TLS method rather than the LS method. These numerical observations contrast with existing analytic perturbation theories for the LS and TLS methods which show that the upper bounds for the LS solution are always smaller than the corresponding upper bounds for the TLS solutions. In this paper we derive a new upper bound for the TLS solution and indicate when the TLS method can be more accurate than the LS method.Many applied problems in signal processing lead to overdetermined systems of linear equations where the matrix and right hand side are determined by the experimental observations (usually in the form of a lime series). It often happens that as the number of columns of the matrix becomes larger, the
基金supported by the National Natural Science Foundation of China,Nos.41874001 and 41664001Support Program for Outstanding Youth Talents in Jiangxi Province,No.20162BCB23050National Key Research and Development Program,No.2016YFB0501405。
文摘When the total least squares(TLS)solution is used to solve the parameters in the errors-in-variables(EIV)model,the obtained parameter estimations will be unreliable in the observations containing systematic errors.To solve this problem,we propose to add the nonparametric part(systematic errors)to the partial EIV model,and build the partial EIV model to weaken the influence of systematic errors.Then,having rewritten the model as a nonlinear model,we derive the formula of parameter estimations based on the penalized total least squares criterion.Furthermore,based on the second-order approximation method of precision estimation,we derive the second-order bias and covariance of parameter estimations and calculate the mean square error(MSE).Aiming at the selection of the smoothing factor,we propose to use the U curve method.The experiments show that the proposed method can mitigate the influence of systematic errors to a certain extent compared with the traditional method and get more reliable parameter estimations and its precision information,which validates the feasibility and effectiveness of the proposed method.
基金supported by the National Natural Science Foundation of China(No.41874001 and No.41664001)Support Program for Outstanding Youth Talents in Jiangxi Province(No.20162BCB23050)National Key Research and Development Program(No.2016YFB0501405)。
文摘The solution of the grey model(GM(1,1)model)generally involves equal-precision observations,and the(co)variance matrix is established from the prior information.However,the data are generally available with unequal-precision measurements in reality.To deal with the errors of all observations for GM(1,1)model with errors-in-variables(EIV)structure,we exploit the total least-squares(TLS)algorithm to estimate the parameters of GM(1,1)model in this paper.Ignoring that the effect of the improper prior stochastic model and the homologous observations may degrade the accuracy of parameter estimation,we further present a nonlinear total least-squares variance component estimation approach for GM(1,1)model,which resorts to the minimum norm quadratic unbiased estimation(MINQUE).The practical and simulative experiments indicate that the presented approach has significant merits in improving the predictive accuracy in comparison with control methods.
基金supported by the National Nature Science Foundation of China (41174009)
文摘In classical regression analysis, the error of independent variable is usually not taken into account in regression analysis. This paper presents two solution methods for the case that both the independent and the dependent variables have errors. These methods are derived from the condition-adjustment and indirect-adjustment models based on the Total-Least-Squares principle. The equivalence of these two methods is also proven in theory.
文摘A novel algorithm for source location by utilizing the time difference of arrival (TDOA) measurements of a signal received at spatially separated sensors is proposed. The algorithm is based on quadratic constraint total least-squares (QC-TLS) method and gives an explicit solution. The total least-squares method is a generalized data fitting method that is appropriate for cases when the system model contains error or is not known exactly, and quadratic constraint, which could be realized via Lagrange multipliers technique, could constrain the solution to the location equations to improve location accuracy. Comparisons of performance with ordinary least-squares are made, and Monte Carlo simulations are performed. Simulation results indicate that the proposed algorithm has high location accuracy and achieves accuracy close to the Cramer-Rao lower bound (CRLB) near the small TDOA measurement error region.
基金supported by the Open Fund of Engineering laboratory of Spatial Information Technology of Highway Geological Disaster Early Warning in Hunan Province(Changsha University of Science & Technology, Grant No:KFJ150602)Hunan Province Science and Technology Program Funded Projects, China (Grant No:2015NK3035)
文摘A functional model named EIO(Errors-In-Observations) is proposed for general TLS(total least-squares)adjustment. The EIO model only considers the correction of the observation vector, but doesn't consider to correct all elements in the design matrix as the EIV(Errors-In-Variables) model does, furthermore, the dimension of cofactor matrix is much smaller. Iterative algorithms for the parameter estimation and their precise covariance matrix are derived rigorously, and the computation steps are also presented. The proposed approach considers the correction of the observations in the coefficient matrix, and ensures their agreements in every matrix elements. Parameters and corrections can be solved at the same time.An approximate solution and a precise solution of the covariance matrix can be achieved by corresponding algorithms. Applications of EIO model and the proposed algorithms are demonstrated with several examples. The results and comparative studies show that the proposed EIO model and algorithms are feasible and reliable for general adjustment problems.
文摘In this paper, we extend matrix scaled total least squares (MSTLS) problem with a single right-hand side to the case of multiple right-hand sides. Firstly, under some mild conditions, this paper gives an explicit expression of the minimum norm solution of MSTLS problem with multiple right-hand sides. Then, we present the Kronecker-product-based formulae for the normwise, mixed and componentwise condition numbers of the MSTLS problem. For easy estimation, we also exhibit Kronecker-product-free upper bounds for these condition numbers. All these results can reduce to those of the total least squares (TLS) problem which were given by Zheng <em>et al</em>. Finally, two numerical experiments are performed to illustrate our results.
文摘超声医学成像因非侵入式、成本低且实时性好而被广泛应用。超声波动方程具有严重的离散不适定问题,迭代化与正则化结合可以解决这一问题,但重建图像质量较差。为解决这一问题,本文在矩量法基础上,引入Tikhonov-Gaussian方法中的滤波因子,用于校正较小奇异值,将复杂的不适定问题转化为容易求解的最小二乘问题,重构出高质量图像。通过实验数据分析,改进后的截断完全最小二乘算法(truncated total least squares,TTLS)重建质量更高,效果更好,相对误差降低了1.16201%,峰值信噪比提高了0.29132%,信噪比提高了3.0269%,结构相似性提高了1.72531%,图像对比度提高了14.21319%。