Post-admission language tests tend to have a restricted range of proficiency levels among test-takers due to considerations made during the admission selection process.Although range restriction can present challenges...Post-admission language tests tend to have a restricted range of proficiency levels among test-takers due to considerations made during the admission selection process.Although range restriction can present challenges for proficiency-focused assessment,it can also bring opportunities to zoom in on fine-grained performance profiles of test-takers.This study reports on the validation of a profile-based rating scale for an ESL writing placement test in a US university.The profile-based rating scale was created by employing a three-staged,hybrid scale development approach,to provide not only accurate placement decisions but also fine-grained diagnostic information regarding ESL students’writing performance profiles.The scale strikes a balance between argument development and lexico-grammar,to better account for the range of writing performances among test-takers.To gather validity evidence for the profile-based rating scale,this study employs a sequential,mixed-methods approach to examine the quality of test-taker performances across profiles and rater perceptions on the scale.Nine certified raters were recruited to conduct independent evaluations of lexicogrammar and argumentation on a sample of 150 test-taker performances.These evaluations were subjected to many-facet Rasch measurement analysis to examine the differences across writing performance profiles included in the rating scale.Next,semi-structured,follow-up interviews were conducted with the raters,to complement the quantitative findings on the usability and effectiveness of the scale.The findings provide supportive evidence for the validity of the profile-based rating scale.I argue that by focusing on performance profiles,post-admission language tests can strengthen the alignment across curriculum,instruction,and assessment in ESL writing programs.展开更多
This paper presents an approach for estimating power of the score test, based on an asymptotic approximation to the power of the score test under contiguous alternatives. The method is applied to the problem of power ...This paper presents an approach for estimating power of the score test, based on an asymptotic approximation to the power of the score test under contiguous alternatives. The method is applied to the problem of power calculations for the score test of heteroscedasticity in European rabbit data (Ratkowsky, 1983). Simulation studies are presented which indicate that the asymptotic approximation to the finite-sample situation is good over a wide range of parameter configurations.展开更多
In the context of offering localized and specified English for Academic Purposes(EAP)courses for university level Chinese EFL learners,this article explores the issues of EAP assessment for finance and economics major...In the context of offering localized and specified English for Academic Purposes(EAP)courses for university level Chinese EFL learners,this article explores the issues of EAP assessment for finance and economics majors.Firstly,the study attempts to define the construct of EAP assessment for Chinese EFL learners of finance and economics majors at university level based on prior research literature on EAP assessment models and multiple stakeholders’needs on EAP skills in universities of finance and economics.Assessment standards of academic English for finance and economics purposes,then,are discussed by adopting IELTS Academic testing framework in line with localized course syllabus.Finally,an EAP assessment framework for Chinese EFL learners of finance and economics majors is proposed in an attempt to develop localized and university-specific assessment framework to generate effective feedback to EAP courses and bring about positive wash-back for EAP learners of finance and economics majors in university level.展开更多
The paper discusses the "Writing Test" in College English Test - Band Four in two aspects. One is the design of the "Writing" form; the other is the scoring process. From the discussion the paper comes to a conclu...The paper discusses the "Writing Test" in College English Test - Band Four in two aspects. One is the design of the "Writing" form; the other is the scoring process. From the discussion the paper comes to a conclusion that the "Writing Test" in CET-4 should be reformed in two ways: the single style of the "Writing" structure should be changed to various styles in design, and the "global scoring" principle used in marking the writing should be changed to "local scoring". At last, the author suggests some ways of how to put the reforming into reality,展开更多
For the improved two-sided projected quasi-Newton algorithms, which were presented in PartI, we prove in this paper that they are locally one-step or two-step superlinearly convergent. Numerical tests are reported the...For the improved two-sided projected quasi-Newton algorithms, which were presented in PartI, we prove in this paper that they are locally one-step or two-step superlinearly convergent. Numerical tests are reported thereafter. Results by solving a set of typical problems selectedfrom literature have demonstrated the extreme importance of these modifications in making Nocedal& Overton's original methon practical. Furthermore, these results show that the improved algoritnmsare very competitive in comparison with some highly praised sequential quadratic programmingmethods.展开更多
This article is concerned with the high-dimensional location testing problem.For highdimensional settings,traditional multivariate-sign-based tests perform poorly or become infeasible since their Type I error rates ar...This article is concerned with the high-dimensional location testing problem.For highdimensional settings,traditional multivariate-sign-based tests perform poorly or become infeasible since their Type I error rates are far away from nominal levels.Several modifications have been proposed to address this challenging issue and shown to perform well.However,most of modified sign-based tests abandon all the correlation information,and this results in power loss in certain cases.We propose a projection weighted sign test to utilize the correlation information.Under mild conditions,we derive the optimal direction and weights with which the proposed projection test possesses asymptotically and locally best power under alternatives.Benefiting from using the sample-splitting idea for estimating the optimal direction,the proposed test is able to retain type-I error rates pretty well with asymptotic distributions,while it can be also highly competitive in terms of robustness.Its advantage relative to existing methods is demonstrated in numerical simulations and a real data example.展开更多
文摘Post-admission language tests tend to have a restricted range of proficiency levels among test-takers due to considerations made during the admission selection process.Although range restriction can present challenges for proficiency-focused assessment,it can also bring opportunities to zoom in on fine-grained performance profiles of test-takers.This study reports on the validation of a profile-based rating scale for an ESL writing placement test in a US university.The profile-based rating scale was created by employing a three-staged,hybrid scale development approach,to provide not only accurate placement decisions but also fine-grained diagnostic information regarding ESL students’writing performance profiles.The scale strikes a balance between argument development and lexico-grammar,to better account for the range of writing performances among test-takers.To gather validity evidence for the profile-based rating scale,this study employs a sequential,mixed-methods approach to examine the quality of test-taker performances across profiles and rater perceptions on the scale.Nine certified raters were recruited to conduct independent evaluations of lexicogrammar and argumentation on a sample of 150 test-taker performances.These evaluations were subjected to many-facet Rasch measurement analysis to examine the differences across writing performance profiles included in the rating scale.Next,semi-structured,follow-up interviews were conducted with the raters,to complement the quantitative findings on the usability and effectiveness of the scale.The findings provide supportive evidence for the validity of the profile-based rating scale.I argue that by focusing on performance profiles,post-admission language tests can strengthen the alignment across curriculum,instruction,and assessment in ESL writing programs.
基金Supported by SSFC(04BTJ002),the National Natural Science Foundation of China(10371016) and the Post-Doctorial Grant in Southeast University.
文摘This paper presents an approach for estimating power of the score test, based on an asymptotic approximation to the power of the score test under contiguous alternatives. The method is applied to the problem of power calculations for the score test of heteroscedasticity in European rabbit data (Ratkowsky, 1983). Simulation studies are presented which indicate that the asymptotic approximation to the finite-sample situation is good over a wide range of parameter configurations.
文摘In the context of offering localized and specified English for Academic Purposes(EAP)courses for university level Chinese EFL learners,this article explores the issues of EAP assessment for finance and economics majors.Firstly,the study attempts to define the construct of EAP assessment for Chinese EFL learners of finance and economics majors at university level based on prior research literature on EAP assessment models and multiple stakeholders’needs on EAP skills in universities of finance and economics.Assessment standards of academic English for finance and economics purposes,then,are discussed by adopting IELTS Academic testing framework in line with localized course syllabus.Finally,an EAP assessment framework for Chinese EFL learners of finance and economics majors is proposed in an attempt to develop localized and university-specific assessment framework to generate effective feedback to EAP courses and bring about positive wash-back for EAP learners of finance and economics majors in university level.
文摘The paper discusses the "Writing Test" in College English Test - Band Four in two aspects. One is the design of the "Writing" form; the other is the scoring process. From the discussion the paper comes to a conclusion that the "Writing Test" in CET-4 should be reformed in two ways: the single style of the "Writing" structure should be changed to various styles in design, and the "global scoring" principle used in marking the writing should be changed to "local scoring". At last, the author suggests some ways of how to put the reforming into reality,
基金This research was supported in part by the National Natural Science Foundation of china
文摘For the improved two-sided projected quasi-Newton algorithms, which were presented in PartI, we prove in this paper that they are locally one-step or two-step superlinearly convergent. Numerical tests are reported thereafter. Results by solving a set of typical problems selectedfrom literature have demonstrated the extreme importance of these modifications in making Nocedal& Overton's original methon practical. Furthermore, these results show that the improved algoritnmsare very competitive in comparison with some highly praised sequential quadratic programmingmethods.
基金NNSF of China Grants(Grant Nos.11925106,11690015,11931001 and 11971247)NSF of Tianjin Grant(Grant Nos.18JCJQJC46000 and 18ZXZNGX00140)+1 种基金111 Project B20016National Science Foundation(Grant Nos.DMS 1820702,DMS 1953196 and DMS 2015539)。
文摘This article is concerned with the high-dimensional location testing problem.For highdimensional settings,traditional multivariate-sign-based tests perform poorly or become infeasible since their Type I error rates are far away from nominal levels.Several modifications have been proposed to address this challenging issue and shown to perform well.However,most of modified sign-based tests abandon all the correlation information,and this results in power loss in certain cases.We propose a projection weighted sign test to utilize the correlation information.Under mild conditions,we derive the optimal direction and weights with which the proposed projection test possesses asymptotically and locally best power under alternatives.Benefiting from using the sample-splitting idea for estimating the optimal direction,the proposed test is able to retain type-I error rates pretty well with asymptotic distributions,while it can be also highly competitive in terms of robustness.Its advantage relative to existing methods is demonstrated in numerical simulations and a real data example.