In this article, a partially linear single-index model /or longitudinal data is investigated. The generalized penalized spline least squares estimates of the unknown parameters are suggested. All parameters can be est...In this article, a partially linear single-index model /or longitudinal data is investigated. The generalized penalized spline least squares estimates of the unknown parameters are suggested. All parameters can be estimated simultaneously by the proposed method while the feature of longitudinal data is considered. The existence, strong consistency and asymptotic normality of the estimators are proved under suitable conditions. A simulation study is conducted to investigate the finite sample performance of the proposed method. Our approach can also be used to study the pure single-index model for longitudinal data.展开更多
The single-index model with monotonic link function is investigated. Firstly, it is showed that the link function h（.） can be viewed by a graphic method. That is, the plot with the fitted response y on the horizonta...The single-index model with monotonic link function is investigated. Firstly, it is showed that the link function h（.） can be viewed by a graphic method. That is, the plot with the fitted response y on the horizontal axis and the observed y on the vertical axis can be used to visualize the link function. It is pointed out that this graphic approach is also applicable even when the link function is not monotonic. Note that many existing nonparametric smoothers can also be used to assess h（.）. Therefore, the I-spline approximation of the link function via maximizing the covariance function with a penalty function is investigated in the present work. The consistency of the criterion is constructed. A small simulation is carried out to evidence the efficiency of the approach proposed in the paper.展开更多
Varying-coefficient single-index model( VCSIM) avoids the so-called "curse of dimensionality " and is flexible enough to include several important statistical models. This paper considers statistical diagnos...Varying-coefficient single-index model( VCSIM) avoids the so-called "curse of dimensionality " and is flexible enough to include several important statistical models. This paper considers statistical diagnosis for VCSIM. First,the parametric estimation equation is established based on empirical likelihood. Then,some diagnosis statistics are defined. At last, an example is given to illustrate all the results.展开更多
In this article, we study the variable selection of partially linear single-index model(PLSIM). Based on the minimized average variance estimation, the variable selection of PLSIM is done by minimizing average varianc...In this article, we study the variable selection of partially linear single-index model(PLSIM). Based on the minimized average variance estimation, the variable selection of PLSIM is done by minimizing average variance with adaptive l1 penalty. Implementation algorithm is given. Under some regular conditions, we demonstrate the oracle properties of aLASSO procedure for PLSIM. Simulations are used to investigate the effectiveness of the proposed method for variable selection of PLSIM.展开更多
We consider the problem of variable selection for the single-index random effects models with longitudinal data. An automatic variable selection procedure is developed using smooth-threshold. The proposed method share...We consider the problem of variable selection for the single-index random effects models with longitudinal data. An automatic variable selection procedure is developed using smooth-threshold. The proposed method shares some of the desired features of existing variable selection methods: the resulting estimator enjoys the oracle property;the proposed procedure avoids the convex optimization problem and is flexible and easy to implement. Moreover, we use the penalized weighted deviance criterion for a data-driven choice of the tuning parameters. Simulation studies are carried out to assess the performance of our method, and a real dataset is analyzed for further illustration.展开更多
In many applications a heterogeneous population consists of several subpopulations. When each subpopulation can be adequately modeled by a heteroscedastic single-index model, the whole population is characterized by a...In many applications a heterogeneous population consists of several subpopulations. When each subpopulation can be adequately modeled by a heteroscedastic single-index model, the whole population is characterized by a finite mixture of heteroscedastic single-index models. In this article, we propose an estimation algorithm for fitting this model, and discuss the implementation in detail. Simulation studies are used to demonstrate the performance of the algorithm, and a real example is used to illustrate the application of the model.展开更多
Single index models are widely used in medicine, econometrics and some other fields. In this paper, we consider the inference of a change point problem in single index models. Based on density-weighted average derivat...Single index models are widely used in medicine, econometrics and some other fields. In this paper, we consider the inference of a change point problem in single index models. Based on density-weighted average derivative estimation (ADE) method, we propose a statistic to test whether a change point exists or not. The null distribution of the test statistic is obtained using a permutation technique. The permuted statistic is rigorously shown to have the same distribution in the limiting sense under both null and alternative hypotheses. After the null hypothesis of no change point is rejected, an ADE-based estimate of the change point is proposed under assumption that the change point is unique. A simulation study confirms the theoretical results.展开更多
In this paper, a partially linear single-index model is investigated, and three empirical log-likelihood ratio statistics for the unknown parameters in the model are suggested. It is proved that the proposed statistic...In this paper, a partially linear single-index model is investigated, and three empirical log-likelihood ratio statistics for the unknown parameters in the model are suggested. It is proved that the proposed statistics are asymptotically standard chi-square under some suitable conditions, and hence can be used to construct the confidence regions of the parameters. Our methods can also deal with the confidence region construction for the index in the pure single-index model. A simulation study indicates that, in terms of coverage probabilities and average areas of the confidence regions, the proposed methods perform better than the least-squares method.展开更多
We consider the problem of variable selection for single-index varying-coefficient model, and present a regularized variable selection procedure by combining basis function approximations with SCAD penalty. The propos...We consider the problem of variable selection for single-index varying-coefficient model, and present a regularized variable selection procedure by combining basis function approximations with SCAD penalty. The proposed procedure simultaneously selects significant covariates with functional coefficients and local significant variables with parametric coefficients. With appropriate selection of the tuning parameters, the consistency of the variable selection procedure and the oracle property of the estimators are established. The proposed method can naturally be applied to deal with pure single-index model and varying-coefficient model. Finite sample performances of the proposed method are illustrated by a simulation study and the real data analysis.展开更多
Statistical inference on parametric part for the partially linear single-index model (PLSIM) is considered in this paper. A profile least-squares technique for estimating the parametric part is proposed and the asympt...Statistical inference on parametric part for the partially linear single-index model (PLSIM) is considered in this paper. A profile least-squares technique for estimating the parametric part is proposed and the asymptotic normality of the profile least-squares estimator is given. Based on the estimator, a generalized likelihood ratio (GLR) test is proposed to test whether parameters on linear part for the model is under a contain linear restricted condition. Under the null model, the proposed GLR statistic follows asymptotically the χ2-distribution with the scale constant and degree of freedom independent of the nuisance parameters, known as Wilks phenomenon. Both simulated and real data examples are used to illustrate our proposed methods.展开更多
We propose a robust estimation procedure based on local Walsh-average regression(LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regul...We propose a robust estimation procedure based on local Walsh-average regression(LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regularity conditions;the estimate of the unknown link function converges at the usual rate for the nonparametric estimation of a univariate covariate. We theoretically demonstrate that the new estimators show significant efficiency gain across a wide spectrum of non-normal error distributions and have almost no loss of efficiency for the normal error. Even in the worst case, the asymptotic relative efficiency(ARE) has a lower bound compared with the least squares(LS) estimates;the lower bounds of the AREs are 0.864 and 0.8896 for the single-index parameter and nonparametric function, respectively. Moreover, the ARE of the proposed LWR-based approach versus the ARE of the LS-based method has an expression that is closely related to the ARE of the signed-rank Wilcoxon test as compared with the t-test. In addition, to obtain a sparse estimate of the single-index parameter, we develop a variable selection procedure by combining the estimation method with smoothly clipped absolute deviation penalty;this procedure is shown to possess the oracle property. We also propose a Bayes information criterion(BIC)-type criterion for selecting the tuning parameter and further prove its ability to consistently identify the true model. We conduct some Monte Carlo simulations and a real data analysis to illustrate the finite sample performance of the proposed methods.展开更多
In this paper, we study the sure independence screening of ultrahigh-dimensional censored data with varying coefficient single-index model. This general model framework covers a large number of commonly used survival ...In this paper, we study the sure independence screening of ultrahigh-dimensional censored data with varying coefficient single-index model. This general model framework covers a large number of commonly used survival models. The property that the proposed method is not derived for a specific model is appealing in ultrahigh dimensional regressions, as it is difficult to specify a correct model for ultrahigh dimensional predictors.Once the assuming data generating process does not meet the actual one, the screening method based on the model will be problematic. We establish the sure screening property and consistency in ranking property of the proposed method. Simulations are conducted to study the finite sample performances, and the results demonstrate that the proposed method is competitive compared with the existing methods. We also illustrate the results via the analysis of data from The National Alzheimers Coordinating Center(NACC).展开更多
Tests for nonparametric parts on partially linear single index models are considered in this paper. Based on the estimates obtained by the local linear method, the generalized likelihood ratio tests for the models are...Tests for nonparametric parts on partially linear single index models are considered in this paper. Based on the estimates obtained by the local linear method, the generalized likelihood ratio tests for the models are established. Under the null hypotheses the normalized tests follow asymptotically the χ2-distribution with the scale constants and the degrees of freedom being independent of the nuisance parameters, which is called the Wilks phenomenon. A simulated example is used to evaluate the performances of the testing procedures empirically.展开更多
This paper considers the problem of change point in single index models.In order to obtain asymptotically valid confidence intervals for the estimation of the change point,the convergence rate and asymptotic distribut...This paper considers the problem of change point in single index models.In order to obtain asymptotically valid confidence intervals for the estimation of the change point,the convergence rate and asymptotic distribution of the change point estimate is studied.Some simulation results are presented which show that the numerical performance of our estimator is satisfactory.展开更多
基金Supported by the National Natural Science Foundation of China (10571008)the Natural Science Foundation of Henan (092300410149)the Core Teacher Foundationof Henan (2006141)
文摘In this article, a partially linear single-index model /or longitudinal data is investigated. The generalized penalized spline least squares estimates of the unknown parameters are suggested. All parameters can be estimated simultaneously by the proposed method while the feature of longitudinal data is considered. The existence, strong consistency and asymptotic normality of the estimators are proved under suitable conditions. A simulation study is conducted to investigate the finite sample performance of the proposed method. Our approach can also be used to study the pure single-index model for longitudinal data.
基金Supported by the National Natural science Foundation of China(10701035)ChenGuang Project of Shang-hai Education Development Foundation(2007CG33)a Special Fund for Young Teachers in Shanghai Universities(79001320)
文摘The single-index model with monotonic link function is investigated. Firstly, it is showed that the link function h（.） can be viewed by a graphic method. That is, the plot with the fitted response y on the horizontal axis and the observed y on the vertical axis can be used to visualize the link function. It is pointed out that this graphic approach is also applicable even when the link function is not monotonic. Note that many existing nonparametric smoothers can also be used to assess h（.）. Therefore, the I-spline approximation of the link function via maximizing the covariance function with a penalty function is investigated in the present work. The consistency of the criterion is constructed. A small simulation is carried out to evidence the efficiency of the approach proposed in the paper.
文摘Varying-coefficient single-index model( VCSIM) avoids the so-called "curse of dimensionality " and is flexible enough to include several important statistical models. This paper considers statistical diagnosis for VCSIM. First,the parametric estimation equation is established based on empirical likelihood. Then,some diagnosis statistics are defined. At last, an example is given to illustrate all the results.
文摘In this article, we study the variable selection of partially linear single-index model(PLSIM). Based on the minimized average variance estimation, the variable selection of PLSIM is done by minimizing average variance with adaptive l1 penalty. Implementation algorithm is given. Under some regular conditions, we demonstrate the oracle properties of aLASSO procedure for PLSIM. Simulations are used to investigate the effectiveness of the proposed method for variable selection of PLSIM.
文摘We consider the problem of variable selection for the single-index random effects models with longitudinal data. An automatic variable selection procedure is developed using smooth-threshold. The proposed method shares some of the desired features of existing variable selection methods: the resulting estimator enjoys the oracle property;the proposed procedure avoids the convex optimization problem and is flexible and easy to implement. Moreover, we use the penalized weighted deviance criterion for a data-driven choice of the tuning parameters. Simulation studies are carried out to assess the performance of our method, and a real dataset is analyzed for further illustration.
文摘In many applications a heterogeneous population consists of several subpopulations. When each subpopulation can be adequately modeled by a heteroscedastic single-index model, the whole population is characterized by a finite mixture of heteroscedastic single-index models. In this article, we propose an estimation algorithm for fitting this model, and discuss the implementation in detail. Simulation studies are used to demonstrate the performance of the algorithm, and a real example is used to illustrate the application of the model.
基金the National Natural Science Foundation of China (Grant Nos. 10471136, 10671189)the Knowledge Innovation Program of the Chinese Academy of Sciences (Grant No. KJCX3-SYW-S02)
文摘Single index models are widely used in medicine, econometrics and some other fields. In this paper, we consider the inference of a change point problem in single index models. Based on density-weighted average derivative estimation (ADE) method, we propose a statistic to test whether a change point exists or not. The null distribution of the test statistic is obtained using a permutation technique. The permuted statistic is rigorously shown to have the same distribution in the limiting sense under both null and alternative hypotheses. After the null hypothesis of no change point is rejected, an ADE-based estimate of the change point is proposed under assumption that the change point is unique. A simulation study confirms the theoretical results.
基金supported by the Natural Science Foundation of Beijing City(Grant No.1042002)Technology Development Plan Project of Beijing Education Committee(Grant No.KM2005 10005009)+1 种基金the Special Grants of Beijing for Talents(Grant No.20041D0501515)supported by a grant from the Research Grants Council of Hong Kong,Hong Kong(Grant No.HKU7060/04P).
文摘In this paper, a partially linear single-index model is investigated, and three empirical log-likelihood ratio statistics for the unknown parameters in the model are suggested. It is proved that the proposed statistics are asymptotically standard chi-square under some suitable conditions, and hence can be used to construct the confidence regions of the parameters. Our methods can also deal with the confidence region construction for the index in the pure single-index model. A simulation study indicates that, in terms of coverage probabilities and average areas of the confidence regions, the proposed methods perform better than the least-squares method.
文摘We consider the problem of variable selection for single-index varying-coefficient model, and present a regularized variable selection procedure by combining basis function approximations with SCAD penalty. The proposed procedure simultaneously selects significant covariates with functional coefficients and local significant variables with parametric coefficients. With appropriate selection of the tuning parameters, the consistency of the variable selection procedure and the oracle property of the estimators are established. The proposed method can naturally be applied to deal with pure single-index model and varying-coefficient model. Finite sample performances of the proposed method are illustrated by a simulation study and the real data analysis.
基金supported by National Natural Science Foundation of China (Grant No. 10871072)Natural Science Foundation of Shanxi Province of China (Grant No. 2007011014)PhD Program Scholarship Fund of ECNU 2009
文摘Statistical inference on parametric part for the partially linear single-index model (PLSIM) is considered in this paper. A profile least-squares technique for estimating the parametric part is proposed and the asymptotic normality of the profile least-squares estimator is given. Based on the estimator, a generalized likelihood ratio (GLR) test is proposed to test whether parameters on linear part for the model is under a contain linear restricted condition. Under the null model, the proposed GLR statistic follows asymptotically the χ2-distribution with the scale constant and degree of freedom independent of the nuisance parameters, known as Wilks phenomenon. Both simulated and real data examples are used to illustrate our proposed methods.
基金partially supported by National Natural Science Foundation of China(Grant Nos.11801168,11801169,11571055 and 11671059)the Natural Science Foundation of Hunan Province(Grant No.2018JJ3322)
文摘We propose a robust estimation procedure based on local Walsh-average regression(LWR) for single-index models. Our novel method provides a root-n consistent estimate of the single-index parameter under some mild regularity conditions;the estimate of the unknown link function converges at the usual rate for the nonparametric estimation of a univariate covariate. We theoretically demonstrate that the new estimators show significant efficiency gain across a wide spectrum of non-normal error distributions and have almost no loss of efficiency for the normal error. Even in the worst case, the asymptotic relative efficiency(ARE) has a lower bound compared with the least squares(LS) estimates;the lower bounds of the AREs are 0.864 and 0.8896 for the single-index parameter and nonparametric function, respectively. Moreover, the ARE of the proposed LWR-based approach versus the ARE of the LS-based method has an expression that is closely related to the ARE of the signed-rank Wilcoxon test as compared with the t-test. In addition, to obtain a sparse estimate of the single-index parameter, we develop a variable selection procedure by combining the estimation method with smoothly clipped absolute deviation penalty;this procedure is shown to possess the oracle property. We also propose a Bayes information criterion(BIC)-type criterion for selecting the tuning parameter and further prove its ability to consistently identify the true model. We conduct some Monte Carlo simulations and a real data analysis to illustrate the finite sample performance of the proposed methods.
基金Supported by the National Natural Science Foundation of China(No.11801567)
文摘In this paper, we study the sure independence screening of ultrahigh-dimensional censored data with varying coefficient single-index model. This general model framework covers a large number of commonly used survival models. The property that the proposed method is not derived for a specific model is appealing in ultrahigh dimensional regressions, as it is difficult to specify a correct model for ultrahigh dimensional predictors.Once the assuming data generating process does not meet the actual one, the screening method based on the model will be problematic. We establish the sure screening property and consistency in ranking property of the proposed method. Simulations are conducted to study the finite sample performances, and the results demonstrate that the proposed method is competitive compared with the existing methods. We also illustrate the results via the analysis of data from The National Alzheimers Coordinating Center(NACC).
基金supported in part by National Natural Science Foundation of China(11171112,11101114,11201190)National Statistical Science Research Major Program of China(2011LZ051)
文摘Tests for nonparametric parts on partially linear single index models are considered in this paper. Based on the estimates obtained by the local linear method, the generalized likelihood ratio tests for the models are established. Under the null hypotheses the normalized tests follow asymptotically the χ2-distribution with the scale constants and the degrees of freedom being independent of the nuisance parameters, which is called the Wilks phenomenon. A simulated example is used to evaluate the performances of the testing procedures empirically.
基金supported by National Natural Science Foundation for Young Scientists of China(Grant Nos.11101397,11201108)the Humanities and Social Sciences Project from Ministry of Education of China(Grant No.12YJC910007)+1 种基金Anhui Provincial Natural Science Foundation(Grant No.1208085QA12)the National Statistical Research Plan Project(Grant No.2012LZ009)
文摘This paper considers the problem of change point in single index models.In order to obtain asymptotically valid confidence intervals for the estimation of the change point,the convergence rate and asymptotic distribution of the change point estimate is studied.Some simulation results are presented which show that the numerical performance of our estimator is satisfactory.
