The 37th Language Testing Research Colloquium(LTRC 2015①)was held at Eaton Chelsea Hotel in Toronto Canada during March 16-20,2015.The first two days of March 16-17 were preconference workshop days with March 18-20 a...The 37th Language Testing Research Colloquium(LTRC 2015①)was held at Eaton Chelsea Hotel in Toronto Canada during March 16-20,2015.The first two days of March 16-17 were preconference workshop days with March 18-20 as the three main conference days.More than 300 participants from 27 countries and regions joined the conference.The top numbers of the展开更多
Assessment and evaluation can not only be used to test the degree of students’acquirement of knowledge but also reflect the qualities and effectiveness of teaching.This research uses SPSS24.0 to carry out the quantit...Assessment and evaluation can not only be used to test the degree of students’acquirement of knowledge but also reflect the qualities and effectiveness of teaching.This research uses SPSS24.0 to carry out the quantitative analysis of the score of a practice test of TEM 4,which provides a reference to the improvement of the TEM4 test and the enlightenment of English teaching.展开更多
Objective:The paper discusses recent evidence on the assessment of language outcomes in children with hearing loss acquiring oral language. Methods: Research emphasizes that language tests must be specific enough to c...Objective:The paper discusses recent evidence on the assessment of language outcomes in children with hearing loss acquiring oral language. Methods: Research emphasizes that language tests must be specific enough to capture subtle deficits in vocabulary and grammar learning at different developmental ages. The Diagnostic Receptive and Expressive Assessment of Mandarin (DREAM) was carefully designed to be a comprehensive standardized Mandarin assessment normed in China's Mainland. Results:This paper summarizes the evidence-based item design process and validity and reliability results of DREAM. A pilot study reported here shows that DREAM provided detailed information about hearing impaired children's language abilities and can be used to aid intervention planning to maximize progress. Conclusion: DREAM represents an example of translational science, transferring methods from empirical studies of language acquisition in research environments into applied domains such as assessment and intervention. Research on outcomes in China will advance significantly with the availability of evidence-based comprehensive language tests that measure a sufficient age range of skills, are normed on Mandarin speaking children in China's Mainland, and are designed to capture features central to Mandarin language acquisition.展开更多
As a large-scale standardized English proficiency test,IELTS attracts millions of test takers internationally.This essay,drawing on current theories in language testing and assessment,attempts to evaluate the writing ...As a large-scale standardized English proficiency test,IELTS attracts millions of test takers internationally.This essay,drawing on current theories in language testing and assessment,attempts to evaluate the writing test of the IELTS Academic Module.It is concluded that it is a generally valid and reliable test which generates overall beneficial effects,though several threats possibly undermine its test validity and reliability.Some suggestions on improvement are proposed at the end.展开更多
With a growing number of foreign language studies on proficiency outcomes,it is imperative to address the challenge of measuring students’proficiency development in a language program where standardized proficiency t...With a growing number of foreign language studies on proficiency outcomes,it is imperative to address the challenge of measuring students’proficiency development in a language program where standardized proficiency testing is not readily available.This article reports administering a Chinese elicited imitation test(EIT)by an instructor to track students’global oral proficiency development in a small language program in a mid-size U.S.public university.The test results from the EIT of second language(L2)Chinese suggest that this tool can provide the instructor with valuable insights into students’oral proficiency.This study also discusses the potential practical value of using this EIT in a language program with limited resources for standardized proficiency assessment.The hope is that this study will encourage language educators who are not already doing so to start using empirical evidence from a valid and reliable proficiency measurement tool to reflect on,improve,and guide their instructional practices.展开更多
Post-admission language tests tend to have a restricted range of proficiency levels among test-takers due to considerations made during the admission selection process.Although range restriction can present challenges...Post-admission language tests tend to have a restricted range of proficiency levels among test-takers due to considerations made during the admission selection process.Although range restriction can present challenges for proficiency-focused assessment,it can also bring opportunities to zoom in on fine-grained performance profiles of test-takers.This study reports on the validation of a profile-based rating scale for an ESL writing placement test in a US university.The profile-based rating scale was created by employing a three-staged,hybrid scale development approach,to provide not only accurate placement decisions but also fine-grained diagnostic information regarding ESL students’writing performance profiles.The scale strikes a balance between argument development and lexico-grammar,to better account for the range of writing performances among test-takers.To gather validity evidence for the profile-based rating scale,this study employs a sequential,mixed-methods approach to examine the quality of test-taker performances across profiles and rater perceptions on the scale.Nine certified raters were recruited to conduct independent evaluations of lexicogrammar and argumentation on a sample of 150 test-taker performances.These evaluations were subjected to many-facet Rasch measurement analysis to examine the differences across writing performance profiles included in the rating scale.Next,semi-structured,follow-up interviews were conducted with the raters,to complement the quantitative findings on the usability and effectiveness of the scale.The findings provide supportive evidence for the validity of the profile-based rating scale.I argue that by focusing on performance profiles,post-admission language tests can strengthen the alignment across curriculum,instruction,and assessment in ESL writing programs.展开更多
CSE (China's Standards of English) is China's first English proficiency assessment standard covering all semester. Its abilitygrading reflects the correspondence between the English level of students in each s...CSE (China's Standards of English) is China's first English proficiency assessment standard covering all semester. Its abilitygrading reflects the correspondence between the English level of students in each scholastic school and the ability to describe thedescriptors, and it is targeted and instructive for college English teaching. As an English assessment reform that benefits allChinese English learners, the Chinese English Proficiency Rating Scale has an epoch-making significance. One of the core tasks ofthe construction of foreign language assessment system is to formulate a unified competency assessment standard, and to provide ascientific competency index system and accurate Competency Scale for various foreign language examinations. CSE provides acommon reference framework for English learning, teaching and assessment in China, and combines English learning, Englishteaching and English assessment system. Improving the quality of teaching is a concern of every English teacher. The introductionof CSE undoubtedly provides authoritative criteria and powerful impetus for the deepening and refinement of College Englishreform.展开更多
Spacecraft automatic test system, a comprehensive spacecraft test information system based on the various spacecraft test specifications formalized as spacecraft test language, is an important means to improve test ef...Spacecraft automatic test system, a comprehensive spacecraft test information system based on the various spacecraft test specifications formalized as spacecraft test language, is an important means to improve test efficiency. With the new require- ments of the multi-spacecraft test in China, the study of the spacecraft test language becomes a new challenge for spacecraft test field. In this article, a high-order spacecraft test language, China aerospace test and operation language (CATOL), is given asso- ciated with the current test requirements; meanwhile, the structure of the language is presented. Then, for characterizing and formalizing the spacecraft processes, the syntax and operational semantics of one of the sub-languages, CATOL-PR, are defined. Finally, the prototype system of this proposed language is presented. This language will improve the specification of spacecraft test work in China and the efficiency of spacecraft testers, and promote the development in spacecraft automatic test.展开更多
Language testing is very important and necessary,and moreover as we all know,nowadays,in English language testing, the muhiple-choice item is most widely used and many users regard the multiple-choice item as the most...Language testing is very important and necessary,and moreover as we all know,nowadays,in English language testing, the muhiple-choice item is most widely used and many users regard the multiple-choice item as the most flexible and probably the most effective of the objective item types.The multiple-choice item has its characteristics,advantages and disadvantages.We should bring out its strengths to make up for its weaknesses and use it appropriately.Although it has its limitations,it is suitable for large-scale tests and tests dealing with wide-range knowledge.We should correctly ap- ply testing principles and methods in order to make testing more effective and reliable.展开更多
s To identify the cortical areas engaged during Chinese word processing using func tional magnetic resonance imaging (fMRI) and to examine the reliability and repr oducibility of fMRI for localization of functional a...s To identify the cortical areas engaged during Chinese word processing using func tional magnetic resonance imaging (fMRI) and to examine the reliability and repr oducibility of fMRI for localization of functional areas in the human brain Methods FMRI data were collected on 8 young, right handed, native Chinese speakers duri ng performance of Chinese synonym and homophone judgment tasks on two different clinical MRI systems (1 5 T GE Signa Horizon and 1 5 T Siemens Vision) A cro ss correlation analysis was used to statistically generate the activation map Results Broca's area, Wernicke's area, bilateral extrastriate, and ventral tempo ral cortex were significantly activated during both the synonym and homophone ac tivities There was essentially no difference between results acquired on two d ifferent MRI systems Conclusions FMRI can be used for localizing cortical areas critical to Chinese language proc essing in the human brain The results are reliable and well reproducible acros s different clinical MRI systems展开更多
文摘The 37th Language Testing Research Colloquium(LTRC 2015①)was held at Eaton Chelsea Hotel in Toronto Canada during March 16-20,2015.The first two days of March 16-17 were preconference workshop days with March 18-20 as the three main conference days.More than 300 participants from 27 countries and regions joined the conference.The top numbers of the
文摘Assessment and evaluation can not only be used to test the degree of students’acquirement of knowledge but also reflect the qualities and effectiveness of teaching.This research uses SPSS24.0 to carry out the quantitative analysis of the score of a practice test of TEM 4,which provides a reference to the improvement of the TEM4 test and the enlightenment of English teaching.
基金the financial support of Bethel Hearing and Speaking Training Center Inc. for all research studies in this paper
文摘Objective:The paper discusses recent evidence on the assessment of language outcomes in children with hearing loss acquiring oral language. Methods: Research emphasizes that language tests must be specific enough to capture subtle deficits in vocabulary and grammar learning at different developmental ages. The Diagnostic Receptive and Expressive Assessment of Mandarin (DREAM) was carefully designed to be a comprehensive standardized Mandarin assessment normed in China's Mainland. Results:This paper summarizes the evidence-based item design process and validity and reliability results of DREAM. A pilot study reported here shows that DREAM provided detailed information about hearing impaired children's language abilities and can be used to aid intervention planning to maximize progress. Conclusion: DREAM represents an example of translational science, transferring methods from empirical studies of language acquisition in research environments into applied domains such as assessment and intervention. Research on outcomes in China will advance significantly with the availability of evidence-based comprehensive language tests that measure a sufficient age range of skills, are normed on Mandarin speaking children in China's Mainland, and are designed to capture features central to Mandarin language acquisition.
文摘As a large-scale standardized English proficiency test,IELTS attracts millions of test takers internationally.This essay,drawing on current theories in language testing and assessment,attempts to evaluate the writing test of the IELTS Academic Module.It is concluded that it is a generally valid and reliable test which generates overall beneficial effects,though several threats possibly undermine its test validity and reliability.Some suggestions on improvement are proposed at the end.
文摘With a growing number of foreign language studies on proficiency outcomes,it is imperative to address the challenge of measuring students’proficiency development in a language program where standardized proficiency testing is not readily available.This article reports administering a Chinese elicited imitation test(EIT)by an instructor to track students’global oral proficiency development in a small language program in a mid-size U.S.public university.The test results from the EIT of second language(L2)Chinese suggest that this tool can provide the instructor with valuable insights into students’oral proficiency.This study also discusses the potential practical value of using this EIT in a language program with limited resources for standardized proficiency assessment.The hope is that this study will encourage language educators who are not already doing so to start using empirical evidence from a valid and reliable proficiency measurement tool to reflect on,improve,and guide their instructional practices.
文摘Post-admission language tests tend to have a restricted range of proficiency levels among test-takers due to considerations made during the admission selection process.Although range restriction can present challenges for proficiency-focused assessment,it can also bring opportunities to zoom in on fine-grained performance profiles of test-takers.This study reports on the validation of a profile-based rating scale for an ESL writing placement test in a US university.The profile-based rating scale was created by employing a three-staged,hybrid scale development approach,to provide not only accurate placement decisions but also fine-grained diagnostic information regarding ESL students’writing performance profiles.The scale strikes a balance between argument development and lexico-grammar,to better account for the range of writing performances among test-takers.To gather validity evidence for the profile-based rating scale,this study employs a sequential,mixed-methods approach to examine the quality of test-taker performances across profiles and rater perceptions on the scale.Nine certified raters were recruited to conduct independent evaluations of lexicogrammar and argumentation on a sample of 150 test-taker performances.These evaluations were subjected to many-facet Rasch measurement analysis to examine the differences across writing performance profiles included in the rating scale.Next,semi-structured,follow-up interviews were conducted with the raters,to complement the quantitative findings on the usability and effectiveness of the scale.The findings provide supportive evidence for the validity of the profile-based rating scale.I argue that by focusing on performance profiles,post-admission language tests can strengthen the alignment across curriculum,instruction,and assessment in ESL writing programs.
文摘CSE (China's Standards of English) is China's first English proficiency assessment standard covering all semester. Its abilitygrading reflects the correspondence between the English level of students in each scholastic school and the ability to describe thedescriptors, and it is targeted and instructive for college English teaching. As an English assessment reform that benefits allChinese English learners, the Chinese English Proficiency Rating Scale has an epoch-making significance. One of the core tasks ofthe construction of foreign language assessment system is to formulate a unified competency assessment standard, and to provide ascientific competency index system and accurate Competency Scale for various foreign language examinations. CSE provides acommon reference framework for English learning, teaching and assessment in China, and combines English learning, Englishteaching and English assessment system. Improving the quality of teaching is a concern of every English teacher. The introductionof CSE undoubtedly provides authoritative criteria and powerful impetus for the deepening and refinement of College Englishreform.
基金National Natural Science Foundation of China (61003016) Supported Project of the State Key Laboratory of Software Development Environment (SKLSDE-2009ZX-13)
文摘Spacecraft automatic test system, a comprehensive spacecraft test information system based on the various spacecraft test specifications formalized as spacecraft test language, is an important means to improve test efficiency. With the new require- ments of the multi-spacecraft test in China, the study of the spacecraft test language becomes a new challenge for spacecraft test field. In this article, a high-order spacecraft test language, China aerospace test and operation language (CATOL), is given asso- ciated with the current test requirements; meanwhile, the structure of the language is presented. Then, for characterizing and formalizing the spacecraft processes, the syntax and operational semantics of one of the sub-languages, CATOL-PR, are defined. Finally, the prototype system of this proposed language is presented. This language will improve the specification of spacecraft test work in China and the efficiency of spacecraft testers, and promote the development in spacecraft automatic test.
文摘Language testing is very important and necessary,and moreover as we all know,nowadays,in English language testing, the muhiple-choice item is most widely used and many users regard the multiple-choice item as the most flexible and probably the most effective of the objective item types.The multiple-choice item has its characteristics,advantages and disadvantages.We should bring out its strengths to make up for its weaknesses and use it appropriately.Although it has its limitations,it is suitable for large-scale tests and tests dealing with wide-range knowledge.We should correctly ap- ply testing principles and methods in order to make testing more effective and reliable.
基金ThisstudywassupportedbygrantsfromtheChineseMinistryofScienceandTechnology (G1 9990 540 0 6)NationalInstitutesofHealth USA (5RO1MH55346)
文摘s To identify the cortical areas engaged during Chinese word processing using func tional magnetic resonance imaging (fMRI) and to examine the reliability and repr oducibility of fMRI for localization of functional areas in the human brain Methods FMRI data were collected on 8 young, right handed, native Chinese speakers duri ng performance of Chinese synonym and homophone judgment tasks on two different clinical MRI systems (1 5 T GE Signa Horizon and 1 5 T Siemens Vision) A cro ss correlation analysis was used to statistically generate the activation map Results Broca's area, Wernicke's area, bilateral extrastriate, and ventral tempo ral cortex were significantly activated during both the synonym and homophone ac tivities There was essentially no difference between results acquired on two d ifferent MRI systems Conclusions FMRI can be used for localizing cortical areas critical to Chinese language proc essing in the human brain The results are reliable and well reproducible acros s different clinical MRI systems