This study examines the writing abilities of Iranian intermediate Korean learners,specifically their performance in the compositional writing section of the Test of Proficiency in Korean(TOPIK).By utilizing the many F...This study examines the writing abilities of Iranian intermediate Korean learners,specifically their performance in the compositional writing section of the Test of Proficiency in Korean(TOPIK).By utilizing the many FACETS-Rasch Model,we meticulously analyzed nine writing samples from the 52nd TOPIK.These samples were evaluated using a modified rubric ranging from 0 to 3 based on predefined criteria for written composition.The results underscored that the sections on“appropriateness of spacing and spelling,”“relevance of vocabulary,”and“content diversity”presented the most significant challenges for the learners.On the other hand,“the quantity of writing”emerged as the least challenging aspect.These findings reveal substantial disparities in various aspects of writing proficiency among learners.The study not only pinpoints issue areas in writing skills,but also underscores the necessity of customized teaching strategies within the TOPIK framework to address these weaknesses.Consequently,it offers valuable insights that could bolster the effectiveness of teaching writing to Korean language learners.The findings of this study are not only significant for the field of language education,but also contribute to a deeper understanding of the challenges faced by intermediate learners and provide a roadmap for improving language instruction.展开更多
Little is known about how the assessment modality,i.e.,computer-based(CB)and paper-based(PB)tests,affects language teachers’scorings,perceptions,and preferences and,therefore,the validity and fairness of classroom wr...Little is known about how the assessment modality,i.e.,computer-based(CB)and paper-based(PB)tests,affects language teachers’scorings,perceptions,and preferences and,therefore,the validity and fairness of classroom writing assessments.The present mixed-methods study used Shaw and Weir’s(2007)sociocognitive writing test validation framework to examine the scoring and consequential validity evidence of CB and PB writing tests in EFL classroom assessment in higher education.Original handwritten and word-processed texts of 38 EFL university students were transcribed to their opposite format and assessed by three language lecturers(N=456 texts,152 per teacher)to examine the scoring validity of CB and PB tests.The teachers’perceptions of text quality and preferences for assessment modality accounted for the consequential validity evidence of both tests.Findings revealed that the assessment modality impacted teachers’scorings,perceptions,and preferences.The teachers awarded higher scores to original and transcribed handwritten texts,particularly text organization and language use.The teachers’perceptions of text quality differed from their ratings,and physical,psychological,and experiential characteristics influenced their preferences for assessment modality.The results have implications for the validity and fairness of CB and PB writing tests and teachers’assessment practices.展开更多
文摘This study examines the writing abilities of Iranian intermediate Korean learners,specifically their performance in the compositional writing section of the Test of Proficiency in Korean(TOPIK).By utilizing the many FACETS-Rasch Model,we meticulously analyzed nine writing samples from the 52nd TOPIK.These samples were evaluated using a modified rubric ranging from 0 to 3 based on predefined criteria for written composition.The results underscored that the sections on“appropriateness of spacing and spelling,”“relevance of vocabulary,”and“content diversity”presented the most significant challenges for the learners.On the other hand,“the quantity of writing”emerged as the least challenging aspect.These findings reveal substantial disparities in various aspects of writing proficiency among learners.The study not only pinpoints issue areas in writing skills,but also underscores the necessity of customized teaching strategies within the TOPIK framework to address these weaknesses.Consequently,it offers valuable insights that could bolster the effectiveness of teaching writing to Korean language learners.The findings of this study are not only significant for the field of language education,but also contribute to a deeper understanding of the challenges faced by intermediate learners and provide a roadmap for improving language instruction.
文摘Little is known about how the assessment modality,i.e.,computer-based(CB)and paper-based(PB)tests,affects language teachers’scorings,perceptions,and preferences and,therefore,the validity and fairness of classroom writing assessments.The present mixed-methods study used Shaw and Weir’s(2007)sociocognitive writing test validation framework to examine the scoring and consequential validity evidence of CB and PB writing tests in EFL classroom assessment in higher education.Original handwritten and word-processed texts of 38 EFL university students were transcribed to their opposite format and assessed by three language lecturers(N=456 texts,152 per teacher)to examine the scoring validity of CB and PB tests.The teachers’perceptions of text quality and preferences for assessment modality accounted for the consequential validity evidence of both tests.Findings revealed that the assessment modality impacted teachers’scorings,perceptions,and preferences.The teachers awarded higher scores to original and transcribed handwritten texts,particularly text organization and language use.The teachers’perceptions of text quality differed from their ratings,and physical,psychological,and experiential characteristics influenced their preferences for assessment modality.The results have implications for the validity and fairness of CB and PB writing tests and teachers’assessment practices.
