We propose a robust estimation procedure based on local Walsh-average regression(LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regul...We propose a robust estimation procedure based on local Walsh-average regression(LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regularity conditions;the estimate of the unknown link function converges at the usual rate for the nonparametric estimation of a univariate covariate. We theoretically demonstrate that the new estimators show significant efficiency gain across a wide spectrum of non-normal error distributions and have almost no loss of efficiency for the normal error. Even in the worst case, the asymptotic relative efficiency(ARE) has a lower bound compared with the least squares(LS) estimates;the lower bounds of the AREs are 0.864 and 0.8896 for the single-index parameter and nonparametric function, respectively. Moreover, the ARE of the proposed LWR-based approach versus the ARE of the LS-based method has an expression that is closely related to the ARE of the signed-rank Wilcoxon test as compared with the t-test. In addition, to obtain a sparse estimate of the single-index parameter, we develop a variable selection procedure by combining the estimation method with smoothly clipped absolute deviation penalty;this procedure is shown to possess the oracle property. We also propose a Bayes information criterion(BIC)-type criterion for selecting the tuning parameter and further prove its ability to consistently identify the true model. We conduct some Monte Carlo simulations and a real data analysis to illustrate the finite sample performance of the proposed methods.展开更多
In this paper we investigate the robust estimation of generalized varying coefficient models in which the unknown regression coefficients may change with different explanatory variables. Based on the B-spline series a...In this paper we investigate the robust estimation of generalized varying coefficient models in which the unknown regression coefficients may change with different explanatory variables. Based on the B-spline series approximation and Walsh-average technique we develop an initial estimator for the unknown regression coefficient functions. By virtue of the initial estimator, the generalized varying coefficient model is reduced to a univariate nonparametric regression model. Then combining the local linear smooth and Walsh average technique we further propose a two-stage local linear Walsh-average estimator for the unknown regression coefficient functions. Under mild assumptions, we establish the large sample theory of the proposed estimators by utilizing the results of U-statistics and shows that the two-stage local linear Walsh-average estimator own an oracle property, namely the asymptotic normality of the two-stage local linear Walsh-average estimator of each coefficient function is not affected by other unknown coefficient functions. Extensive simulation studies are conducted to assess the finite sample performance, and a real example is analyzed to illustrate the proposed method.展开更多
基金partially supported by National Natural Science Foundation of China(Grant Nos.11801168,11801169,11571055 and 11671059)the Natural Science Foundation of Hunan Province(Grant No.2018JJ3322)
文摘We propose a robust estimation procedure based on local Walsh-average regression(LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regularity conditions;the estimate of the unknown link function converges at the usual rate for the nonparametric estimation of a univariate covariate. We theoretically demonstrate that the new estimators show significant efficiency gain across a wide spectrum of non-normal error distributions and have almost no loss of efficiency for the normal error. Even in the worst case, the asymptotic relative efficiency(ARE) has a lower bound compared with the least squares(LS) estimates;the lower bounds of the AREs are 0.864 and 0.8896 for the single-index parameter and nonparametric function, respectively. Moreover, the ARE of the proposed LWR-based approach versus the ARE of the LS-based method has an expression that is closely related to the ARE of the signed-rank Wilcoxon test as compared with the t-test. In addition, to obtain a sparse estimate of the single-index parameter, we develop a variable selection procedure by combining the estimation method with smoothly clipped absolute deviation penalty;this procedure is shown to possess the oracle property. We also propose a Bayes information criterion(BIC)-type criterion for selecting the tuning parameter and further prove its ability to consistently identify the true model. We conduct some Monte Carlo simulations and a real data analysis to illustrate the finite sample performance of the proposed methods.
基金Supported by the National Natural Science Foundation of China(NSFC)(No.11471203)the Graduate Innovation Fund of Shanghai University of Finance and Economics(CXJJ-2013-459)
文摘In this paper we investigate the robust estimation of generalized varying coefficient models in which the unknown regression coefficients may change with different explanatory variables. Based on the B-spline series approximation and Walsh-average technique we develop an initial estimator for the unknown regression coefficient functions. By virtue of the initial estimator, the generalized varying coefficient model is reduced to a univariate nonparametric regression model. Then combining the local linear smooth and Walsh average technique we further propose a two-stage local linear Walsh-average estimator for the unknown regression coefficient functions. Under mild assumptions, we establish the large sample theory of the proposed estimators by utilizing the results of U-statistics and shows that the two-stage local linear Walsh-average estimator own an oracle property, namely the asymptotic normality of the two-stage local linear Walsh-average estimator of each coefficient function is not affected by other unknown coefficient functions. Extensive simulation studies are conducted to assess the finite sample performance, and a real example is analyzed to illustrate the proposed method.