It was suggested by Pantanen that the mean squared error may be used to measure the inefficiency of the least squares estimator. Styan[2] and Rao[3] et al. discussed this inefficiency and it's bound later. In this...It was suggested by Pantanen that the mean squared error may be used to measure the inefficiency of the least squares estimator. Styan[2] and Rao[3] et al. discussed this inefficiency and it's bound later. In this paper we propose a new inefficiency of the least squares estimator with the measure of generalized variance and obtain its bound.展开更多
The paper introduces a new biased estimator namely Generalized Optimal Estimator (GOE) in a multiple linear regression when there exists multicollinearity among predictor variables. Stochastic properties of proposed e...The paper introduces a new biased estimator namely Generalized Optimal Estimator (GOE) in a multiple linear regression when there exists multicollinearity among predictor variables. Stochastic properties of proposed estimator were derived, and the proposed estimator was compared with other existing biased estimators based on sample information in the the Scalar Mean Square Error (SMSE) criterion by using a Monte Carlo simulation study and two numerical illustrations.展开更多
The solution properties of semiparametric model are analyzed, especially that penalized least squares for semiparametric model will be invalid when the matrix B^TPB is ill-posed or singular. According to the principle...The solution properties of semiparametric model are analyzed, especially that penalized least squares for semiparametric model will be invalid when the matrix B^TPB is ill-posed or singular. According to the principle of ridge estimate for linear parametric model, generalized penalized least squares for semiparametric model are put forward, and some formulae and statistical properties of estimates are derived. Finally according to simulation examples some helpful conclusions are drawn.展开更多
Factor analysis (FA) is a time-honored multivariate analysis procedure for exploring the factors underlying observed variables. In this paper, we propose a new algorithm for the generalized least squares (GLS) estimat...Factor analysis (FA) is a time-honored multivariate analysis procedure for exploring the factors underlying observed variables. In this paper, we propose a new algorithm for the generalized least squares (GLS) estimation in FA. In the algorithm, a majorization step and diagonal steps are alternately iterated until convergence is reached, where Kiers and ten Berge’s (1992) majorization technique is used for the former step, and the latter ones are formulated as minimizing simple quadratic functions of diagonal matrices. This procedure is named a majorizing-diagonal (MD) algorithm. In contrast to the existing gradient approaches, differential calculus is not used and only elmentary matrix computations are required in the MD algorithm. A simuation study shows that the proposed MD algorithm recovers parameters better than the existing algorithms.展开更多
In this paper, we define a new class of biased linear estimators of the vector of unknown parameters in the deficient_rank linear model based on the spectral decomposition expression of the best linear minimun bias es...In this paper, we define a new class of biased linear estimators of the vector of unknown parameters in the deficient_rank linear model based on the spectral decomposition expression of the best linear minimun bias estimator. Some important properties are discussed. By appropriate choices of bias parameters, we construct many interested and useful biased linear estimators, which are the extension of ordinary biased linear estimators in the full_rank linear model to the deficient_rank linear model. At last, we give a numerical example in geodetic adjustment.展开更多
In this paper, the performance of existing biased estimators (Ridge Estimator (RE), Almost Unbiased Ridge Estimator (AURE), Liu Estimator (LE), Almost Unbiased Liu Estimator (AULE), Principal Component Regression Esti...In this paper, the performance of existing biased estimators (Ridge Estimator (RE), Almost Unbiased Ridge Estimator (AURE), Liu Estimator (LE), Almost Unbiased Liu Estimator (AULE), Principal Component Regression Estimator (PCRE), r-k class estimator and r-d class estimator) and the respective predictors were considered in a misspecified linear regression model when there exists multicollinearity among explanatory variables. A generalized form was used to compare these estimators and predictors in the mean square error sense. Further, theoretical findings were established using mean square error matrix and scalar mean square error. Finally, a numerical example and a Monte Carlo simulation study were done to illustrate the theoretical findings. The simulation study revealed that LE and RE outperform the other estimators when weak multicollinearity exists, and RE, r-k class and r-d class estimators outperform the other estimators when moderated and high multicollinearity exist for certain values of shrinkage parameters, respectively. The predictors based on the LE and RE are always superior to the other predictors for certain values of shrinkage parameters.展开更多
传统的误差配准算法假设系统偏差恒定或缓慢变化,当系统误差发生突变或快速变化时,这一假设不再成立。针对这一问题,研究了时变条件下的误差配准算法,引入渐消因子,对常规的基于地心地固坐标系的广义最小二乘算法(generalized least squ...传统的误差配准算法假设系统偏差恒定或缓慢变化,当系统误差发生突变或快速变化时,这一假设不再成立。针对这一问题,研究了时变条件下的误差配准算法,引入渐消因子,对常规的基于地心地固坐标系的广义最小二乘算法(generalized least squares algorithm based on the earth-centered earth-fixed coordinate system,ECEF-GLS)进行了修正,弱化历史量测对配准的影响,并对渐消因子的选取问题进行了研究,给出了合理的设计方法。算法验证表明,基于渐消因子的ECEF-GLS估计算法能够对时变的系统偏差进行有效估计,精度满足配准要求。展开更多
Maximum likelihood (ML) estimation for the generalized asymmetric Laplace (GAL) distribution also known as Variance gamma using simplex direct search algorithms is investigated. In this paper, we use numerical direct ...Maximum likelihood (ML) estimation for the generalized asymmetric Laplace (GAL) distribution also known as Variance gamma using simplex direct search algorithms is investigated. In this paper, we use numerical direct search techniques for maximizing the log-likelihood to obtain ML estimators instead of using the traditional EM algorithm. The density function of the GAL is only continuous but not differentiable with respect to the parameters and the appearance of the Bessel function in the density make it difficult to obtain the asymptotic covariance matrix for the entire GAL family. Using M-estimation theory, the properties of the ML estimators are investigated in this paper. The ML estimators are shown to be consistent for the GAL family and their asymptotic normality can only be guaranteed for the asymmetric Laplace (AL) family. The asymptotic covariance matrix is obtained for the AL family and it completes the results obtained previously in the literature. For the general GAL model, alternative methods of inferences based on quadratic distances (QD) are proposed. The QD methods appear to be overall more efficient than likelihood methods infinite samples using sample sizes n ≤5000 and the range of parameters often encountered for financial data. The proposed methods only require that the moment generating function of the parametric model exists and has a closed form expression and can be used for other models.展开更多
A residual carrier frequency offset (CFO) estimation scheme is proposed for the uplink of orthogonal frequency division multiple access (OFDMA) systems. Multiple access interference caused by CFOs in the uplink is...A residual carrier frequency offset (CFO) estimation scheme is proposed for the uplink of orthogonal frequency division multiple access (OFDMA) systems. Multiple access interference caused by CFOs in the uplink is investigated, as it severely affects the performance of a classical maximum likelihood (ML) frequency estimator. By the use of the estimated CFOs of the active users, the linear maximum mean square error (LMMSE) equalization is performed before the ML frequency estimator for the interference cancellation, which can help to sufficiently improve the estimation accuracy for the residual CFO of the incoming user. Analysis and simulations show that the modified ML estimator provides a tradeoff between estimation accuracy and computational complexity caused by the LMMSE interference cancellation, and the proposed method allows OFDMA systems flexibly allocating subcarriers to users.展开更多
When multicollinearity is present in a set of the regression variables,the least square estimate of the regression coefficient tends to be unstable and it may lead to erroneous inference.In this paper,generalized ridg...When multicollinearity is present in a set of the regression variables,the least square estimate of the regression coefficient tends to be unstable and it may lead to erroneous inference.In this paper,generalized ridge estimate(K)of the regression coefficient=vec(B)is considered in multivaiale linear regression model.The MSE of the above estimate is less than the MSE of the least square estimate by choosing the ridge parameter matrix K.Moreover,it is pointed out that the Criterion MSE for choosing matrix K of generalized ridge estimate has several weaknesses.In order to overcome these weaknesses,a new family of criteria Q(c)is adpoted which includes the criterion MSE and criterion LS as its special case.The good properties of the criteria Q(c)are proved and discussed from theoretical point of view.The statistical meaning of the scale c is explained and the methods of determining c are also given.展开更多
In this paper,we propose a new biased estimator of the regression parameters,the generalized ridge and principal correlation estimator.We present its some properties and prove that it is superior to LSE(least squares ...In this paper,we propose a new biased estimator of the regression parameters,the generalized ridge and principal correlation estimator.We present its some properties and prove that it is superior to LSE(least squares estimator),principal correlation estimator,ridge and principal correlation estimator under MSE(mean squares error) and PMC(Pitman closeness) criterion,respectively.展开更多
文摘It was suggested by Pantanen that the mean squared error may be used to measure the inefficiency of the least squares estimator. Styan[2] and Rao[3] et al. discussed this inefficiency and it's bound later. In this paper we propose a new inefficiency of the least squares estimator with the measure of generalized variance and obtain its bound.
文摘The paper introduces a new biased estimator namely Generalized Optimal Estimator (GOE) in a multiple linear regression when there exists multicollinearity among predictor variables. Stochastic properties of proposed estimator were derived, and the proposed estimator was compared with other existing biased estimators based on sample information in the the Scalar Mean Square Error (SMSE) criterion by using a Monte Carlo simulation study and two numerical illustrations.
基金Funded by the National Nature Science Foundation of China(No.40274005) .
文摘The solution properties of semiparametric model are analyzed, especially that penalized least squares for semiparametric model will be invalid when the matrix B^TPB is ill-posed or singular. According to the principle of ridge estimate for linear parametric model, generalized penalized least squares for semiparametric model are put forward, and some formulae and statistical properties of estimates are derived. Finally according to simulation examples some helpful conclusions are drawn.
文摘Factor analysis (FA) is a time-honored multivariate analysis procedure for exploring the factors underlying observed variables. In this paper, we propose a new algorithm for the generalized least squares (GLS) estimation in FA. In the algorithm, a majorization step and diagonal steps are alternately iterated until convergence is reached, where Kiers and ten Berge’s (1992) majorization technique is used for the former step, and the latter ones are formulated as minimizing simple quadratic functions of diagonal matrices. This procedure is named a majorizing-diagonal (MD) algorithm. In contrast to the existing gradient approaches, differential calculus is not used and only elmentary matrix computations are required in the MD algorithm. A simuation study shows that the proposed MD algorithm recovers parameters better than the existing algorithms.
文摘In this paper, we define a new class of biased linear estimators of the vector of unknown parameters in the deficient_rank linear model based on the spectral decomposition expression of the best linear minimun bias estimator. Some important properties are discussed. By appropriate choices of bias parameters, we construct many interested and useful biased linear estimators, which are the extension of ordinary biased linear estimators in the full_rank linear model to the deficient_rank linear model. At last, we give a numerical example in geodetic adjustment.
文摘In this paper, the performance of existing biased estimators (Ridge Estimator (RE), Almost Unbiased Ridge Estimator (AURE), Liu Estimator (LE), Almost Unbiased Liu Estimator (AULE), Principal Component Regression Estimator (PCRE), r-k class estimator and r-d class estimator) and the respective predictors were considered in a misspecified linear regression model when there exists multicollinearity among explanatory variables. A generalized form was used to compare these estimators and predictors in the mean square error sense. Further, theoretical findings were established using mean square error matrix and scalar mean square error. Finally, a numerical example and a Monte Carlo simulation study were done to illustrate the theoretical findings. The simulation study revealed that LE and RE outperform the other estimators when weak multicollinearity exists, and RE, r-k class and r-d class estimators outperform the other estimators when moderated and high multicollinearity exist for certain values of shrinkage parameters, respectively. The predictors based on the LE and RE are always superior to the other predictors for certain values of shrinkage parameters.
文摘传统的误差配准算法假设系统偏差恒定或缓慢变化,当系统误差发生突变或快速变化时,这一假设不再成立。针对这一问题,研究了时变条件下的误差配准算法,引入渐消因子,对常规的基于地心地固坐标系的广义最小二乘算法(generalized least squares algorithm based on the earth-centered earth-fixed coordinate system,ECEF-GLS)进行了修正,弱化历史量测对配准的影响,并对渐消因子的选取问题进行了研究,给出了合理的设计方法。算法验证表明,基于渐消因子的ECEF-GLS估计算法能够对时变的系统偏差进行有效估计,精度满足配准要求。
文摘Maximum likelihood (ML) estimation for the generalized asymmetric Laplace (GAL) distribution also known as Variance gamma using simplex direct search algorithms is investigated. In this paper, we use numerical direct search techniques for maximizing the log-likelihood to obtain ML estimators instead of using the traditional EM algorithm. The density function of the GAL is only continuous but not differentiable with respect to the parameters and the appearance of the Bessel function in the density make it difficult to obtain the asymptotic covariance matrix for the entire GAL family. Using M-estimation theory, the properties of the ML estimators are investigated in this paper. The ML estimators are shown to be consistent for the GAL family and their asymptotic normality can only be guaranteed for the asymmetric Laplace (AL) family. The asymptotic covariance matrix is obtained for the AL family and it completes the results obtained previously in the literature. For the general GAL model, alternative methods of inferences based on quadratic distances (QD) are proposed. The QD methods appear to be overall more efficient than likelihood methods infinite samples using sample sizes n ≤5000 and the range of parameters often encountered for financial data. The proposed methods only require that the moment generating function of the parametric model exists and has a closed form expression and can be used for other models.
基金Supported by the National High Technology Research and Development Programme of China (No. 2009AA011501), National Basic Research Program of China (No. 2007CB310608), the Fundamental Research Funds for the Central Universities in China, and China Postdoctoral Science Foundation funded project.
文摘A residual carrier frequency offset (CFO) estimation scheme is proposed for the uplink of orthogonal frequency division multiple access (OFDMA) systems. Multiple access interference caused by CFOs in the uplink is investigated, as it severely affects the performance of a classical maximum likelihood (ML) frequency estimator. By the use of the estimated CFOs of the active users, the linear maximum mean square error (LMMSE) equalization is performed before the ML frequency estimator for the interference cancellation, which can help to sufficiently improve the estimation accuracy for the residual CFO of the incoming user. Analysis and simulations show that the modified ML estimator provides a tradeoff between estimation accuracy and computational complexity caused by the LMMSE interference cancellation, and the proposed method allows OFDMA systems flexibly allocating subcarriers to users.
基金The projects Supported by Natural Science Foundation of Fujian Province
文摘When multicollinearity is present in a set of the regression variables,the least square estimate of the regression coefficient tends to be unstable and it may lead to erroneous inference.In this paper,generalized ridge estimate(K)of the regression coefficient=vec(B)is considered in multivaiale linear regression model.The MSE of the above estimate is less than the MSE of the least square estimate by choosing the ridge parameter matrix K.Moreover,it is pointed out that the Criterion MSE for choosing matrix K of generalized ridge estimate has several weaknesses.In order to overcome these weaknesses,a new family of criteria Q(c)is adpoted which includes the criterion MSE and criterion LS as its special case.The good properties of the criteria Q(c)are proved and discussed from theoretical point of view.The statistical meaning of the scale c is explained and the methods of determining c are also given.
基金Foundation item: the National Natural Science Foundation of China (Nos. 60736047 10671007+2 种基金 60772036) the Foundation of Beijing Jiaotong University (Nos. 2006XM037 2007XM046).
文摘In this paper,we propose a new biased estimator of the regression parameters,the generalized ridge and principal correlation estimator.We present its some properties and prove that it is superior to LSE(least squares estimator),principal correlation estimator,ridge and principal correlation estimator under MSE(mean squares error) and PMC(Pitman closeness) criterion,respectively.