Post-admission language tests tend to have a restricted range of proficiency levels among test-takers due to considerations made during the admission selection process.Although range restriction can present challenges...Post-admission language tests tend to have a restricted range of proficiency levels among test-takers due to considerations made during the admission selection process.Although range restriction can present challenges for proficiency-focused assessment,it can also bring opportunities to zoom in on fine-grained performance profiles of test-takers.This study reports on the validation of a profile-based rating scale for an ESL writing placement test in a US university.The profile-based rating scale was created by employing a three-staged,hybrid scale development approach,to provide not only accurate placement decisions but also fine-grained diagnostic information regarding ESL students’writing performance profiles.The scale strikes a balance between argument development and lexico-grammar,to better account for the range of writing performances among test-takers.To gather validity evidence for the profile-based rating scale,this study employs a sequential,mixed-methods approach to examine the quality of test-taker performances across profiles and rater perceptions on the scale.Nine certified raters were recruited to conduct independent evaluations of lexicogrammar and argumentation on a sample of 150 test-taker performances.These evaluations were subjected to many-facet Rasch measurement analysis to examine the differences across writing performance profiles included in the rating scale.Next,semi-structured,follow-up interviews were conducted with the raters,to complement the quantitative findings on the usability and effectiveness of the scale.The findings provide supportive evidence for the validity of the profile-based rating scale.I argue that by focusing on performance profiles,post-admission language tests can strengthen the alignment across curriculum,instruction,and assessment in ESL writing programs.展开更多
Rural masses in India view English as the language of socio-economic empowerment through education. Education could be either in English or in regional languages, but children should learn English, because it is seen ...Rural masses in India view English as the language of socio-economic empowerment through education. Education could be either in English or in regional languages, but children should learn English, because it is seen as the key to the world of opportunities in higher education and employment. The governments need to politically respond to the aspirations of the common masses keeping aside both politicised language policies and theoretical linguistic inputs that encourage one＇s mother tongue as the ideal medium of instruction. Onerous responsibility lays on men, methods, and materials over which government have the least say, but the practising teachers of English and academics who help bureaucrats in framing language policies in India are solely responsible for non-realization of dreams of the masses. There is something terribly rotten in the state of English-teaching enterprise in India. This paper proposes to examine the present state of affairs in the teaching of English to rural students and to offer constructive alternatives to the existing package of men, materials, and methods.展开更多
文摘Post-admission language tests tend to have a restricted range of proficiency levels among test-takers due to considerations made during the admission selection process.Although range restriction can present challenges for proficiency-focused assessment,it can also bring opportunities to zoom in on fine-grained performance profiles of test-takers.This study reports on the validation of a profile-based rating scale for an ESL writing placement test in a US university.The profile-based rating scale was created by employing a three-staged,hybrid scale development approach,to provide not only accurate placement decisions but also fine-grained diagnostic information regarding ESL students’writing performance profiles.The scale strikes a balance between argument development and lexico-grammar,to better account for the range of writing performances among test-takers.To gather validity evidence for the profile-based rating scale,this study employs a sequential,mixed-methods approach to examine the quality of test-taker performances across profiles and rater perceptions on the scale.Nine certified raters were recruited to conduct independent evaluations of lexicogrammar and argumentation on a sample of 150 test-taker performances.These evaluations were subjected to many-facet Rasch measurement analysis to examine the differences across writing performance profiles included in the rating scale.Next,semi-structured,follow-up interviews were conducted with the raters,to complement the quantitative findings on the usability and effectiveness of the scale.The findings provide supportive evidence for the validity of the profile-based rating scale.I argue that by focusing on performance profiles,post-admission language tests can strengthen the alignment across curriculum,instruction,and assessment in ESL writing programs.
文摘Rural masses in India view English as the language of socio-economic empowerment through education. Education could be either in English or in regional languages, but children should learn English, because it is seen as the key to the world of opportunities in higher education and employment. The governments need to politically respond to the aspirations of the common masses keeping aside both politicised language policies and theoretical linguistic inputs that encourage one＇s mother tongue as the ideal medium of instruction. Onerous responsibility lays on men, methods, and materials over which government have the least say, but the practising teachers of English and academics who help bureaucrats in framing language policies in India are solely responsible for non-realization of dreams of the masses. There is something terribly rotten in the state of English-teaching enterprise in India. This paper proposes to examine the present state of affairs in the teaching of English to rural students and to offer constructive alternatives to the existing package of men, materials, and methods.
