基于应试者角度的越南标准化英语水平测试效度验证

A Validity Study on the Vietnamese Standardized Test of English Proficiency:From Test-takers’Perspectives

基于Weir的社会-认知效度验证框架与Cheng等的主题分析框架,从应试者特征、语境和结果3个方面收集越南标准化英语水平测试(VSTEP)的效度证据,采用主题编码法对50名应试者参加VSTEP测试的反思日记进行分析,提出VSTEP效度验证框架。结果表明,备考、心理因素和测试内容是影响VSTEP效度的3个主要因素,VSTEP总体上具有较高的效度,但也存在一些不足。据此,提出应重视应试者的心理状态、研发相应的测试学习资源、保证测试环境良好、合理安排测试等建议。从应试者角度获取证据验证大规模语言测试的效度是十分必要的。

Based on Weir’s Socio-cognitive Framework for Validating Tests and Cheng’s Thematic Framework,this paper collects validity evidences of the Vietnamese Standardized Test of English Proficiency(VSTEP.3-5)from the aspects of test-taker characteristics,context and consequence,uses a thematic coding process to analyze 50 test-takers’reflective journals on VSTEP.3-5,and proposes a validation framework of VSTEP.3-5.The results show that test preparation,psychological factors and test content are the 3 main factors that affect the validity of VSTEP.3-5.In general,VSTEP.3-5 has a relatively high validity,but also has some limitations.Accordingly,some suggestions are put forward as follows:a)Test-takers should pay attention to their own psychological states while attaching importance to test preparation and effectively preparing for the test;b)Test developers can develop corresponding test learning resources,such as VSTEP.3-5 test preparation guide,VSTEP.3-5 test preparation books,VSTEP.3-5 practice tests and so on;c)Test administrators should ensure that the test environment is good,the test arrangement is reasonable,and the reliability and validity of VSTEP.3-5 are not affected by the outside world.From the test-takers’perspectives,this paper aims to provide strong evidences for the validity of VSTEP.3-5,and further shows the necessity of obtaining evidences from the perspectives of test-takers to verify the validity of large-scale language tests.