This article is concerned with the estimating problem of semiparametric varyingcoefficient partially linear regression models. By combining the local polynomial and least squares procedures Fan and Huang (2005) prop...This article is concerned with the estimating problem of semiparametric varyingcoefficient partially linear regression models. By combining the local polynomial and least squares procedures Fan and Huang (2005) proposed a profile least squares estimator for the parametric component and established its asymptotic normality. We further show that the profile least squares estimator can achieve the law of iterated logarithm. Moreover, we study the estimators of the functions characterizing the non-linear part as well as the error variance. The strong convergence rate and the law of iterated logarithm are derived for them, respectively.展开更多
This paper simultaneously investigates variable selection and imputation estimation of semiparametric partially linear varying-coefficient model in that case where there exist missing responses for cluster data. As is...This paper simultaneously investigates variable selection and imputation estimation of semiparametric partially linear varying-coefficient model in that case where there exist missing responses for cluster data. As is well known, commonly used approach to deal with missing data is complete-case data. Combined the idea of complete-case data with a discussion of shrinkage estimation is made on different cluster. In order to avoid the biased results as well as improve the estimation efficiency, this article introduces Group Least Absolute Shrinkage and Selection Operator (Group Lasso) to semiparametric model. That is to say, the method combines the approach of local polynomial smoothing and the Least Absolute Shrinkage and Selection Operator. In that case, it can conduct nonparametric estimation and variable selection in a computationally efficient manner. According to the same criterion, the parametric estimators are also obtained. Additionally, for each cluster, the nonparametric and parametric estimators are derived, and then compute the weighted average per cluster as finally estimators. Moreover, the large sample properties of estimators are also derived respectively.展开更多
In this paper, we present a variable selection procedure by combining basis function approximations with penalized estimating equations for semiparametric varying-coefficient partially linear models with missing respo...In this paper, we present a variable selection procedure by combining basis function approximations with penalized estimating equations for semiparametric varying-coefficient partially linear models with missing response at random. The proposed procedure simultaneously selects significant variables in parametric components and nonparametric components. With appropriate selection of the tuning parameters, we establish the consistency of the variable selection procedure and the convergence rate of the regularized estimators. A simulation study is undertaken to assess the finite sample performance of the proposed variable selection procedure.展开更多
This paper proposes an empirical likelihood based diagnostic technique for heteroscedasticity for semiparametric varying-coefficient partially linear models with missing responses. Firstly, the authors complement the ...This paper proposes an empirical likelihood based diagnostic technique for heteroscedasticity for semiparametric varying-coefficient partially linear models with missing responses. Firstly, the authors complement the missing response variables by regression method. Then, the empirical likelihood method is introduced to study the heteroscedasticity of the semiparametric varying-coefficient partially linear models with complete-case data. Finally, the authors obtain the finite sample property by numerical simulation.展开更多
In this paper,we focus on the partially linear varying-coefficient quantile regression with missing observations under ultra-high dimension,where the missing observations include either responses or covariates or the ...In this paper,we focus on the partially linear varying-coefficient quantile regression with missing observations under ultra-high dimension,where the missing observations include either responses or covariates or the responses and part of the covariates are missing at random,and the ultra-high dimension implies that the dimension of parameter is much larger than sample size.Based on the B-spline method for the varying coefficient functions,we study the consistency of the oracle estimator which is obtained only using active covariates whose coefficients are nonzero.At the same time,we discuss the asymptotic normality of the oracle estimator for the linear parameter.Note that the active covariates are unknown in practice,non-convex penalized estimator is investigated for simultaneous variable selection and estimation,whose oracle property is also established.Finite sample behavior of the proposed methods is investigated via simulations and real data analysis.展开更多
This paper studies estimation and serial correlation test of a semiparametric varying-coefficient partially linear EV model of the form Y = X^Tβ +Z^Tα(T) +ε,ξ = X + η with the identifying condition E[(ε,...This paper studies estimation and serial correlation test of a semiparametric varying-coefficient partially linear EV model of the form Y = X^Tβ +Z^Tα(T) +ε,ξ = X + η with the identifying condition E[(ε,η^T)^T] =0, Cov[(ε,η^T)^T] = σ^2Ip+1. The estimators of interested regression parameters /3 , and the model error variance σ2, as well as the nonparametric components α(T), are constructed. Under some regular conditions, we show that the estimators of the unknown vector β and the unknown parameter σ2 are strongly consistent and asymptotically normal and that the estimator of α(T) achieves the optimal strong convergence rate of the usual nonparametric regression. Based on these estimators and asymptotic properties, we propose the VN,p test statistic and empirical log-likelihood ratio statistic for testing serial correlation in the model. The proposed statistics are shown to have asymptotic normal or chi-square distributions under the null hypothesis of no serial correlation. Some simulation studies are conducted to illustrate the finite sample performance of the proposed tests.展开更多
We consider the semiparametric partially linear regression models with mean function XTβ + g(z), where X and z are functional data. The new estimators of β and g(z) are presented and some asymptotic results are...We consider the semiparametric partially linear regression models with mean function XTβ + g(z), where X and z are functional data. The new estimators of β and g(z) are presented and some asymptotic results are given. The strong convergence rates of the proposed estimators are obtained. In our estimation, the observation number of each subject will be completely flexible. Some simulation study is conducted to investigate the finite sample performance of the proposed estimators.展开更多
Consider a repeated measurement partially linear regression model with anunknown vector parameter β_1, an unknown function g(·), and unknown heteroscedastic errorvariances. In order to improve the semiparametric...Consider a repeated measurement partially linear regression model with anunknown vector parameter β_1, an unknown function g(·), and unknown heteroscedastic errorvariances. In order to improve the semiparametric generalized least squares estimator (SGLSE) of ,we propose an iterative weighted semiparametric least squares estimator (IWSLSE) and show that itimproves upon the SGLSE in terms of asymptotic covariance matrix. An adaptive procedure is given todetermine the number of iterations. We also show that when the number of replicates is less than orequal to two, the IWSLSE can not improve upon the SGLSE. These results are generalizations of thosein [2] to the case of semiparametric regressions.展开更多
This article considers a semiparametric varying-coefficient partially linear binary regression model. The semiparametric varying-coefficient partially linear regression binary model which is a generalization of binary...This article considers a semiparametric varying-coefficient partially linear binary regression model. The semiparametric varying-coefficient partially linear regression binary model which is a generalization of binary regression model and varying-coefficient regression model that allows one to explore the possibly nonlinear effect of a certain covariate on the response variable. A Sieve maximum likelihood estimation method is proposed and the asymptotic properties of the proposed estimators are discussed. One of our main objects is to estimate nonparametric component and the unknowen parameters simultaneously. It is easier to compute, and the required computation burden is much less than that of the existing two-stage estimation method. Under some mild conditions, the estimators are shown to be strongly consistent. The convergence rate of the estimator for the unknown smooth function is obtained, and the estimator for the unknown parameter is shown to be asymptotically efficient and normally distributed. Simulation studies are carried out to investigate the performance of the proposed method.展开更多
The varying-coefficient partially linear regression model is proposed by combining nonparametric and varying-coefficient regression procedures. Wong, et al. (2008) proposed the model and gave its estimation by the l...The varying-coefficient partially linear regression model is proposed by combining nonparametric and varying-coefficient regression procedures. Wong, et al. (2008) proposed the model and gave its estimation by the local linear method. In this paper its inference is addressed. Based on these estimates, the generalized like- lihood ratio test is established. Under the null hypotheses the normalized test statistic follows a x2-distribution asymptotically, with the scale constant and the degrees of freedom being independent of the nuisance param- eters. This is the Wilks phenomenon. Furthermore its asymptotic power is also derived, which achieves the optimal rate of convergence for nonparametric hypotheses testing. A simulation and a real example are used to evaluate the performances of the testing procedures empirically.展开更多
We are concerned with robust estimation procedures to estimate the parameters in partially linear models with large-dimensional covariates. To enhance the interpretability, we suggest implementing a nonconcave regular...We are concerned with robust estimation procedures to estimate the parameters in partially linear models with large-dimensional covariates. To enhance the interpretability, we suggest implementing a nonconcave regularization method in the robust estimation procedure to select important covariates from the linear component. We establish the consistency for both the linear and the nonlinear components when the covariate dimension diverges at the rate of o(n1/2), where n is the sample size. We show that the robust estimate of linear component performs asymptotically as well as its oracle counterpart which assumes the baseline function and the unimportant covariates were known a priori. With a consistent estimator of the linear component, we estimate the nonparametric component by a robust local linear regression. It is proved that the robust estimate of nonlinear component performs asymptotically as well as if the linear component were known in advance.Comprehensive simulation studies are carried out and an application is presented to examine the fnite-sample performance of the proposed procedures.展开更多
Consider a partially linear regression model with an unknown vector parameter , an unknown function g(·), and unknown heteroscedastic error variances. Chen, You<SUP>[23]</SUP> proposed a semiparametri...Consider a partially linear regression model with an unknown vector parameter , an unknown function g(·), and unknown heteroscedastic error variances. Chen, You<SUP>[23]</SUP> proposed a semiparametric generalized least squares estimator (SGLSE) for , which takes the heteroscedasticity into account to increase efficiency. For inference based on this SGLSE, it is necessary to construct a consistent estimator for its asymptotic covariance matrix. However, when there exists within-group correlation, the traditional delta method and the delete-1 jackknife estimation fail to offer such a consistent estimator. In this paper, by deleting grouped partial residuals a delete-group jackknife method is examined. It is shown that the delete-group jackknife method indeed can provide a consistent estimator for the asymptotic covariance matrix in the presence of within-group correlations. This result is an extension of that in [21].展开更多
Semiparametric regression models and estimating covariance functions are very useful for longitudinal study. To heed the positive-definiteness constraint, we adopt the modified Cholesky decomposition approach to decom...Semiparametric regression models and estimating covariance functions are very useful for longitudinal study. To heed the positive-definiteness constraint, we adopt the modified Cholesky decomposition approach to decompose the covariance structure. Then the covariance structure is fitted by a semiparametric model by imposing parametric within-subject correlation while allowing the nonparametric variation function. We estimate regression functions by using the local linear technique and propose generalized estimating equations for the mean and correlation parameter. Kernel estimators are developed for the estimation of the nonparametric variation function. Asymptotic normality of the the resulting estimators is established. Finally, the simulation study and the real data analysis are used to illustrate the proposed approach.展开更多
基金supported by the National Natural Science Funds for Distinguished Young Scholar (70825004)National Natural Science Foundation of China (NSFC) (10731010 and 10628104)+3 种基金the National Basic Research Program (2007CB814902)Creative Research Groups of China (10721101)Leading Academic Discipline Program, the 10th five year plan of 211 Project for Shanghai University of Finance and Economics211 Project for Shanghai University of Financeand Economics (the 3rd phase)
文摘This article is concerned with the estimating problem of semiparametric varyingcoefficient partially linear regression models. By combining the local polynomial and least squares procedures Fan and Huang (2005) proposed a profile least squares estimator for the parametric component and established its asymptotic normality. We further show that the profile least squares estimator can achieve the law of iterated logarithm. Moreover, we study the estimators of the functions characterizing the non-linear part as well as the error variance. The strong convergence rate and the law of iterated logarithm are derived for them, respectively.
文摘This paper simultaneously investigates variable selection and imputation estimation of semiparametric partially linear varying-coefficient model in that case where there exist missing responses for cluster data. As is well known, commonly used approach to deal with missing data is complete-case data. Combined the idea of complete-case data with a discussion of shrinkage estimation is made on different cluster. In order to avoid the biased results as well as improve the estimation efficiency, this article introduces Group Least Absolute Shrinkage and Selection Operator (Group Lasso) to semiparametric model. That is to say, the method combines the approach of local polynomial smoothing and the Least Absolute Shrinkage and Selection Operator. In that case, it can conduct nonparametric estimation and variable selection in a computationally efficient manner. According to the same criterion, the parametric estimators are also obtained. Additionally, for each cluster, the nonparametric and parametric estimators are derived, and then compute the weighted average per cluster as finally estimators. Moreover, the large sample properties of estimators are also derived respectively.
基金Supported by National Natural Science Foundation of China (Grant No. 10871013), Natural Science Foundation of Beijing (Grant No. 1072004), and Natural Science Foundation of Guangxi Province (Grant No. 2010GXNSFB013051)
文摘In this paper, we present a variable selection procedure by combining basis function approximations with penalized estimating equations for semiparametric varying-coefficient partially linear models with missing response at random. The proposed procedure simultaneously selects significant variables in parametric components and nonparametric components. With appropriate selection of the tuning parameters, we establish the consistency of the variable selection procedure and the convergence rate of the regularized estimators. A simulation study is undertaken to assess the finite sample performance of the proposed variable selection procedure.
基金supported by the National Natural Science Foundation of China under Grant Nos. 11471060 and 11871124the Key Project of Statistical Science of China under Grant No. 2017LZ27。
文摘This paper proposes an empirical likelihood based diagnostic technique for heteroscedasticity for semiparametric varying-coefficient partially linear models with missing responses. Firstly, the authors complement the missing response variables by regression method. Then, the empirical likelihood method is introduced to study the heteroscedasticity of the semiparametric varying-coefficient partially linear models with complete-case data. Finally, the authors obtain the finite sample property by numerical simulation.
基金Supported by National Natural Science Foundation of China(Grant No.12071348)Fundamental Research Funds for Central Universities,China(Grant No.2023-3-2D-04)。
文摘In this paper,we focus on the partially linear varying-coefficient quantile regression with missing observations under ultra-high dimension,where the missing observations include either responses or covariates or the responses and part of the covariates are missing at random,and the ultra-high dimension implies that the dimension of parameter is much larger than sample size.Based on the B-spline method for the varying coefficient functions,we study the consistency of the oracle estimator which is obtained only using active covariates whose coefficients are nonzero.At the same time,we discuss the asymptotic normality of the oracle estimator for the linear parameter.Note that the active covariates are unknown in practice,non-convex penalized estimator is investigated for simultaneous variable selection and estimation,whose oracle property is also established.Finite sample behavior of the proposed methods is investigated via simulations and real data analysis.
基金Supported by the National Natural Science Foundation of China (No.40574003) the National Natural Science of Hunan (NO.03JJY3065).
文摘This paper studies estimation and serial correlation test of a semiparametric varying-coefficient partially linear EV model of the form Y = X^Tβ +Z^Tα(T) +ε,ξ = X + η with the identifying condition E[(ε,η^T)^T] =0, Cov[(ε,η^T)^T] = σ^2Ip+1. The estimators of interested regression parameters /3 , and the model error variance σ2, as well as the nonparametric components α(T), are constructed. Under some regular conditions, we show that the estimators of the unknown vector β and the unknown parameter σ2 are strongly consistent and asymptotically normal and that the estimator of α(T) achieves the optimal strong convergence rate of the usual nonparametric regression. Based on these estimators and asymptotic properties, we propose the VN,p test statistic and empirical log-likelihood ratio statistic for testing serial correlation in the model. The proposed statistics are shown to have asymptotic normal or chi-square distributions under the null hypothesis of no serial correlation. Some simulation studies are conducted to illustrate the finite sample performance of the proposed tests.
文摘We consider the semiparametric partially linear regression models with mean function XTβ + g(z), where X and z are functional data. The new estimators of β and g(z) are presented and some asymptotic results are given. The strong convergence rates of the proposed estimators are obtained. In our estimation, the observation number of each subject will be completely flexible. Some simulation study is conducted to investigate the finite sample performance of the proposed estimators.
基金supported by a grant from the Natural Sciences and Engineering Research Council of Canada.
文摘Consider a repeated measurement partially linear regression model with anunknown vector parameter β_1, an unknown function g(·), and unknown heteroscedastic errorvariances. In order to improve the semiparametric generalized least squares estimator (SGLSE) of ,we propose an iterative weighted semiparametric least squares estimator (IWSLSE) and show that itimproves upon the SGLSE in terms of asymptotic covariance matrix. An adaptive procedure is given todetermine the number of iterations. We also show that when the number of replicates is less than orequal to two, the IWSLSE can not improve upon the SGLSE. These results are generalizations of thosein [2] to the case of semiparametric regressions.
基金Supported by National Natural Science Foundation of China (Grant Nos.10771017,10971015,10901020)Key Project of MOE,PRC (Grant No.309007)
文摘This article considers a semiparametric varying-coefficient partially linear binary regression model. The semiparametric varying-coefficient partially linear regression binary model which is a generalization of binary regression model and varying-coefficient regression model that allows one to explore the possibly nonlinear effect of a certain covariate on the response variable. A Sieve maximum likelihood estimation method is proposed and the asymptotic properties of the proposed estimators are discussed. One of our main objects is to estimate nonparametric component and the unknowen parameters simultaneously. It is easier to compute, and the required computation burden is much less than that of the existing two-stage estimation method. Under some mild conditions, the estimators are shown to be strongly consistent. The convergence rate of the estimator for the unknown smooth function is obtained, and the estimator for the unknown parameter is shown to be asymptotically efficient and normally distributed. Simulation studies are carried out to investigate the performance of the proposed method.
基金supported in part by National Natural Science Foundation of China(11171112,11201190)Doctoral Fund of Ministry of Education of China(20130076110004)+1 种基金Program of Shanghai Subject Chief Scientist(14XD1401600)the 111 Project of China(B14019)
文摘The varying-coefficient partially linear regression model is proposed by combining nonparametric and varying-coefficient regression procedures. Wong, et al. (2008) proposed the model and gave its estimation by the local linear method. In this paper its inference is addressed. Based on these estimates, the generalized like- lihood ratio test is established. Under the null hypotheses the normalized test statistic follows a x2-distribution asymptotically, with the scale constant and the degrees of freedom being independent of the nuisance param- eters. This is the Wilks phenomenon. Furthermore its asymptotic power is also derived, which achieves the optimal rate of convergence for nonparametric hypotheses testing. A simulation and a real example are used to evaluate the performances of the testing procedures empirically.
基金supported by National Institute on Drug Abuse(Grant Nos.R21-DA024260 and P50-DA10075)National Natural Science Foundation of China(Grant Nos.11071077,11371236,11028103,11071022 and 11028103)+2 种基金Innovation Program of Shanghai Municipal Education CommissionPujiang Project of Science and Technology Commission of Shanghai Municipality(Grant No.12PJ1403200)Program for New Century Excellent Talents,Ministry of Education of China(Grant No.NCET-12-0901)
文摘We are concerned with robust estimation procedures to estimate the parameters in partially linear models with large-dimensional covariates. To enhance the interpretability, we suggest implementing a nonconcave regularization method in the robust estimation procedure to select important covariates from the linear component. We establish the consistency for both the linear and the nonlinear components when the covariate dimension diverges at the rate of o(n1/2), where n is the sample size. We show that the robust estimate of linear component performs asymptotically as well as its oracle counterpart which assumes the baseline function and the unimportant covariates were known a priori. With a consistent estimator of the linear component, we estimate the nonparametric component by a robust local linear regression. It is proved that the robust estimate of nonlinear component performs asymptotically as well as if the linear component were known in advance.Comprehensive simulation studies are carried out and an application is presented to examine the fnite-sample performance of the proposed procedures.
文摘Consider a partially linear regression model with an unknown vector parameter , an unknown function g(·), and unknown heteroscedastic error variances. Chen, You<SUP>[23]</SUP> proposed a semiparametric generalized least squares estimator (SGLSE) for , which takes the heteroscedasticity into account to increase efficiency. For inference based on this SGLSE, it is necessary to construct a consistent estimator for its asymptotic covariance matrix. However, when there exists within-group correlation, the traditional delta method and the delete-1 jackknife estimation fail to offer such a consistent estimator. In this paper, by deleting grouped partial residuals a delete-group jackknife method is examined. It is shown that the delete-group jackknife method indeed can provide a consistent estimator for the asymptotic covariance matrix in the presence of within-group correlations. This result is an extension of that in [21].
基金supported by National Natural Science Foundation of China (GrantNos.10931002,10911120386)
文摘Semiparametric regression models and estimating covariance functions are very useful for longitudinal study. To heed the positive-definiteness constraint, we adopt the modified Cholesky decomposition approach to decompose the covariance structure. Then the covariance structure is fitted by a semiparametric model by imposing parametric within-subject correlation while allowing the nonparametric variation function. We estimate regression functions by using the local linear technique and propose generalized estimating equations for the mean and correlation parameter. Kernel estimators are developed for the estimation of the nonparametric variation function. Asymptotic normality of the the resulting estimators is established. Finally, the simulation study and the real data analysis are used to illustrate the proposed approach.