Little is known about how the assessment modality,i.e.,computer-based(CB)and paper-based(PB)tests,affects language teachers’scorings,perceptions,and preferences and,therefore,the validity and fairness of classroom wr...Little is known about how the assessment modality,i.e.,computer-based(CB)and paper-based(PB)tests,affects language teachers’scorings,perceptions,and preferences and,therefore,the validity and fairness of classroom writing assessments.The present mixed-methods study used Shaw and Weir’s(2007)sociocognitive writing test validation framework to examine the scoring and consequential validity evidence of CB and PB writing tests in EFL classroom assessment in higher education.Original handwritten and word-processed texts of 38 EFL university students were transcribed to their opposite format and assessed by three language lecturers(N=456 texts,152 per teacher)to examine the scoring validity of CB and PB tests.The teachers’perceptions of text quality and preferences for assessment modality accounted for the consequential validity evidence of both tests.Findings revealed that the assessment modality impacted teachers’scorings,perceptions,and preferences.The teachers awarded higher scores to original and transcribed handwritten texts,particularly text organization and language use.The teachers’perceptions of text quality differed from their ratings,and physical,psychological,and experiential characteristics influenced their preferences for assessment modality.The results have implications for the validity and fairness of CB and PB writing tests and teachers’assessment practices.展开更多
This article is mainly talked about CET English writing tests from the perspective of language testing.Writing tests designed to test the language proficiency,have direct and integrative characteristics.Writing requir...This article is mainly talked about CET English writing tests from the perspective of language testing.Writing tests designed to test the language proficiency,have direct and integrative characteristics.Writing requires the candidates to use language accurately,fluently and appropriately.展开更多
This paper is to investigate whether the CET-4 writing section has positive effect in terms of Communicative Language Testing.The questionnaire survey method is adopted to carry out the research to collect data.It is ...This paper is to investigate whether the CET-4 writing section has positive effect in terms of Communicative Language Testing.The questionnaire survey method is adopted to carry out the research to collect data.It is concluded that currently the CET-4 writing section has certain harmful effect upon English learning of college non-English major students.Further reforms and improvement from the perspective of communicative language testing concerning the scoring criteria and the design of the task should be the focus of the future.展开更多
The testing of second language speaking is a relatively new field; even within the young discipline of applied linguistics.One of the main problems underlying speaking tests is that "speaking" is a difficult...The testing of second language speaking is a relatively new field; even within the young discipline of applied linguistics.One of the main problems underlying speaking tests is that "speaking" is a difficult construct to define. As to the speaking test and the writing test,there are many differences between the two. In spite of these, the similarities are greater than the differences. We shall discuss the differences shortly only in part one but I believe it will be useful to look at the points on which the two are the same. Therefore, I will do a comparative study of the speaking test and the writing test in the paper.展开更多
As a subjective test, the validity of writing test is acceptable. What about the reliability? Writing test occupies a special position in the senior high school entrance examination(SHSEE for short). It is important t...As a subjective test, the validity of writing test is acceptable. What about the reliability? Writing test occupies a special position in the senior high school entrance examination(SHSEE for short). It is important to ensure its reliability. By the analysis of recent years' English writing items in SHSEE, the author offer suggestions on how to guarantee the reliability of writing tests.展开更多
College English Test is one of large-scale examination in our country. Since it was operated in 1987, the test developers kept on test designing and test analysis. In 2013, the Committee of College English Test announ...College English Test is one of large-scale examination in our country. Since it was operated in 1987, the test developers kept on test designing and test analysis. In 2013, the Committee of College English Test announced to reform CET exams. This paper is mainly to analyze the reform in the writing part of CET4 based on language testing theory. Also, it aims to give a revision of the writing part considering the disadvantages of the reformed one.展开更多
This article takes the validation of NMET writing tests as a point of penetration to examine meticulously and fastidiously whether tests of this kind influence on a national basis can test what it is supposed to test....This article takes the validation of NMET writing tests as a point of penetration to examine meticulously and fastidiously whether tests of this kind influence on a national basis can test what it is supposed to test.Here,I shall deal with this issue in a twofold manner,viz.face validity and content validity.Moreover,I also aim to produce findings that could help to guide revisions and promote effectiveness of NMET.After the quantifying and categorizing data collected,I eventually came up with four tables to clearly demonstrate the twofold validity of NMET writing tests.展开更多
Writing test , wins its popularity in measuring the mastery of one's language ability. In view of the significant role writing playing in a test , some considerations on writing test construction are presented in ...Writing test , wins its popularity in measuring the mastery of one's language ability. In view of the significant role writing playing in a test , some considerations on writing test construction are presented in this paper which anticipates the effective ways for measuring one's complex language ability of application.展开更多
The aim of this study is to conduct the validity analysis of the test paper of the academic English reading and writing course referring to the freshmen of non-English majors in a university of Technology in Shanghai....The aim of this study is to conduct the validity analysis of the test paper of the academic English reading and writing course referring to the freshmen of non-English majors in a university of Technology in Shanghai.The validity is mainly analyzed from these three aspects:the content and construct validity,the reaction process,and the internal structure of the test paper.And the principles of language assessment in the design of the test paper are given in this study.The validity study was also conducted in a class with 42 freshmen,and the scores of them were analyzed through the internal correlation coefficient from Statistic Package for Social Science(SPSS)25.0.Finally,the validity of the test paper is concluded.展开更多
The study is a qualitative research by adopting classroom observations and interviews to investigate three teachers in aHigher Vocational College at Hainan. It aims to explore the washback effect of the writing part o...The study is a qualitative research by adopting classroom observations and interviews to investigate three teachers in aHigher Vocational College at Hainan. It aims to explore the washback effect of the writing part of PRETCO-A, to discover its posi-tive or negative washback effect and to propose some realistic suggestions of fostering positive washback effect on writing instruc-tion.展开更多
This paper analyzes the design and implementation of a normal writing test in a senior high school. In line with theories of test evaluation, an effective writing test should try to meet the balance of the six usefuln...This paper analyzes the design and implementation of a normal writing test in a senior high school. In line with theories of test evaluation, an effective writing test should try to meet the balance of the six usefulness, which will be discussed in this paper; thereafter, pedagogical implications will be mentioned with an emphasis on how a test affects the teachers in changing their teaching approaches and motivates the learners in achieving higher goals in their writing proficiency.展开更多
The paper discusses the ＂Writing Test＂ in College English Test - Band Four in two aspects. One is the design of the ＂Writing＂ form; the other is the scoring process. From the discussion the paper comes to a conclu...The paper discusses the ＂Writing Test＂ in College English Test - Band Four in two aspects. One is the design of the ＂Writing＂ form; the other is the scoring process. From the discussion the paper comes to a conclusion that the ＂Writing Test＂ in CET-4 should be reformed in two ways： the single style of the ＂Writing＂ structure should be changed to various styles in design, and the ＂global scoring＂ principle used in marking the writing should be changed to ＂local scoring＂. At last, the author suggests some ways of how to put the reforming into reality,展开更多
Note-taking and Summary Writing reflects the true nature of listening comprehension in communication,represents a true and relatively overall picture of the college students' communicative language ability.It has ...Note-taking and Summary Writing reflects the true nature of listening comprehension in communication,represents a true and relatively overall picture of the college students' communicative language ability.It has high validity,acceptable reliability and positive washback effect,and thus is a promising alternative to Multiple Choice as a listening test method in some large-scale tests.展开更多
Based on the introduction of IELTS writing test,this paper discusses the washback effects of IELTS writing test on English teaching inChina,in hopes of helping teachers to focus more on the language development in the...Based on the introduction of IELTS writing test,this paper discusses the washback effects of IELTS writing test on English teaching inChina,in hopes of helping teachers to focus more on the language development in the preparation courses,which should be the positive washback of IELTS test.展开更多
As a large-scale standardized English proficiency test,IELTS attracts millions of test takers internationally.This essay,drawing on current theories in language testing and assessment,attempts to evaluate the writing ...As a large-scale standardized English proficiency test,IELTS attracts millions of test takers internationally.This essay,drawing on current theories in language testing and assessment,attempts to evaluate the writing test of the IELTS Academic Module.It is concluded that it is a generally valid and reliable test which generates overall beneficial effects,though several threats possibly undermine its test validity and reliability.Some suggestions on improvement are proposed at the end.展开更多
The International English Language Testing System(IELTS) is one of the most widely used language proficiency test inthe world. In the IELTS academic module, the writing test is a significant part to assess examinees&#...The International English Language Testing System(IELTS) is one of the most widely used language proficiency test inthe world. In the IELTS academic module, the writing test is a significant part to assess examinees' writing ability on the ground ofthe university academic level. Since the IELTS academic writing test measures test-takers' academic writing competency and pre-pares them for the university study, it is necessary to figure out the extent this test could be beneficial to test-takers for future uni-versity learning. This paper aims to provide a critical review of the IELTS writing test, dawning on"principles of test assessment"introduced by Brown and Abeywickrama(2010), and focusing particularly on the predictive validity, authenticity, and washback.展开更多
文摘Little is known about how the assessment modality,i.e.,computer-based(CB)and paper-based(PB)tests,affects language teachers’scorings,perceptions,and preferences and,therefore,the validity and fairness of classroom writing assessments.The present mixed-methods study used Shaw and Weir’s(2007)sociocognitive writing test validation framework to examine the scoring and consequential validity evidence of CB and PB writing tests in EFL classroom assessment in higher education.Original handwritten and word-processed texts of 38 EFL university students were transcribed to their opposite format and assessed by three language lecturers(N=456 texts,152 per teacher)to examine the scoring validity of CB and PB tests.The teachers’perceptions of text quality and preferences for assessment modality accounted for the consequential validity evidence of both tests.Findings revealed that the assessment modality impacted teachers’scorings,perceptions,and preferences.The teachers awarded higher scores to original and transcribed handwritten texts,particularly text organization and language use.The teachers’perceptions of text quality differed from their ratings,and physical,psychological,and experiential characteristics influenced their preferences for assessment modality.The results have implications for the validity and fairness of CB and PB writing tests and teachers’assessment practices.
文摘This article is mainly talked about CET English writing tests from the perspective of language testing.Writing tests designed to test the language proficiency,have direct and integrative characteristics.Writing requires the candidates to use language accurately,fluently and appropriately.
文摘This paper is to investigate whether the CET-4 writing section has positive effect in terms of Communicative Language Testing.The questionnaire survey method is adopted to carry out the research to collect data.It is concluded that currently the CET-4 writing section has certain harmful effect upon English learning of college non-English major students.Further reforms and improvement from the perspective of communicative language testing concerning the scoring criteria and the design of the task should be the focus of the future.
文摘The testing of second language speaking is a relatively new field; even within the young discipline of applied linguistics.One of the main problems underlying speaking tests is that "speaking" is a difficult construct to define. As to the speaking test and the writing test,there are many differences between the two. In spite of these, the similarities are greater than the differences. We shall discuss the differences shortly only in part one but I believe it will be useful to look at the points on which the two are the same. Therefore, I will do a comparative study of the speaking test and the writing test in the paper.
文摘As a subjective test, the validity of writing test is acceptable. What about the reliability? Writing test occupies a special position in the senior high school entrance examination(SHSEE for short). It is important to ensure its reliability. By the analysis of recent years' English writing items in SHSEE, the author offer suggestions on how to guarantee the reliability of writing tests.
文摘College English Test is one of large-scale examination in our country. Since it was operated in 1987, the test developers kept on test designing and test analysis. In 2013, the Committee of College English Test announced to reform CET exams. This paper is mainly to analyze the reform in the writing part of CET4 based on language testing theory. Also, it aims to give a revision of the writing part considering the disadvantages of the reformed one.
文摘This article takes the validation of NMET writing tests as a point of penetration to examine meticulously and fastidiously whether tests of this kind influence on a national basis can test what it is supposed to test.Here,I shall deal with this issue in a twofold manner,viz.face validity and content validity.Moreover,I also aim to produce findings that could help to guide revisions and promote effectiveness of NMET.After the quantifying and categorizing data collected,I eventually came up with four tables to clearly demonstrate the twofold validity of NMET writing tests.
文摘Writing test , wins its popularity in measuring the mastery of one's language ability. In view of the significant role writing playing in a test , some considerations on writing test construction are presented in this paper which anticipates the effective ways for measuring one's complex language ability of application.
文摘The aim of this study is to conduct the validity analysis of the test paper of the academic English reading and writing course referring to the freshmen of non-English majors in a university of Technology in Shanghai.The validity is mainly analyzed from these three aspects:the content and construct validity,the reaction process,and the internal structure of the test paper.And the principles of language assessment in the design of the test paper are given in this study.The validity study was also conducted in a class with 42 freshmen,and the scores of them were analyzed through the internal correlation coefficient from Statistic Package for Social Science(SPSS)25.0.Finally,the validity of the test paper is concluded.
文摘The study is a qualitative research by adopting classroom observations and interviews to investigate three teachers in aHigher Vocational College at Hainan. It aims to explore the washback effect of the writing part of PRETCO-A, to discover its posi-tive or negative washback effect and to propose some realistic suggestions of fostering positive washback effect on writing instruc-tion.
文摘This paper analyzes the design and implementation of a normal writing test in a senior high school. In line with theories of test evaluation, an effective writing test should try to meet the balance of the six usefulness, which will be discussed in this paper; thereafter, pedagogical implications will be mentioned with an emphasis on how a test affects the teachers in changing their teaching approaches and motivates the learners in achieving higher goals in their writing proficiency.
文摘The paper discusses the ＂Writing Test＂ in College English Test - Band Four in two aspects. One is the design of the ＂Writing＂ form; the other is the scoring process. From the discussion the paper comes to a conclusion that the ＂Writing Test＂ in CET-4 should be reformed in two ways： the single style of the ＂Writing＂ structure should be changed to various styles in design, and the ＂global scoring＂ principle used in marking the writing should be changed to ＂local scoring＂. At last, the author suggests some ways of how to put the reforming into reality,
文摘Note-taking and Summary Writing reflects the true nature of listening comprehension in communication,represents a true and relatively overall picture of the college students' communicative language ability.It has high validity,acceptable reliability and positive washback effect,and thus is a promising alternative to Multiple Choice as a listening test method in some large-scale tests.
文摘Based on the introduction of IELTS writing test,this paper discusses the washback effects of IELTS writing test on English teaching inChina,in hopes of helping teachers to focus more on the language development in the preparation courses,which should be the positive washback of IELTS test.
文摘As a large-scale standardized English proficiency test,IELTS attracts millions of test takers internationally.This essay,drawing on current theories in language testing and assessment,attempts to evaluate the writing test of the IELTS Academic Module.It is concluded that it is a generally valid and reliable test which generates overall beneficial effects,though several threats possibly undermine its test validity and reliability.Some suggestions on improvement are proposed at the end.
文摘The International English Language Testing System(IELTS) is one of the most widely used language proficiency test inthe world. In the IELTS academic module, the writing test is a significant part to assess examinees' writing ability on the ground ofthe university academic level. Since the IELTS academic writing test measures test-takers' academic writing competency and pre-pares them for the university study, it is necessary to figure out the extent this test could be beneficial to test-takers for future uni-versity learning. This paper aims to provide a critical review of the IELTS writing test, dawning on"principles of test assessment"introduced by Brown and Abeywickrama(2010), and focusing particularly on the predictive validity, authenticity, and washback.
