基于证据的职业技能评价方法有效性框架构建

Construction of Evidence-based Validity Framework for Vocational Competence Evaluation Method

借鉴语言测试的AUA测试框架,以信度理论和整体效度观为理论基础,运用修正式德尔菲法构建了包括4项一级指标、11项二级指标和33项三级指标的职业技能评价方法有效性框架。研究发现:信度、效度是职业技能评价方法在评价技术上最重要的质量标准;职业技能评价方法的有效性评价不仅关注评价工具本身的有效性,还注重评价及其结果使用的有效性;对职业技能评价方法的有效性评价是基于证据的有效性论证;所构建的有效性框架具有良好的应用价值和可推广性。在设计职业技能评价方法时,建议将信度和效度理论作为理论基础,关注评价及其结果的使用对考生、院校和企业的影响,注重利益相关者的参与,关注评价的公平性。

The study draws on the Assessment Use Argument framework of language testing,takes reliability and unified validity as the theoretical basis,and uses the modified Delphi method to construct a validity framework for vocational competence evaluation methods,and the results found that:reliability and validity are the most important quality standards of vocational competence evaluation methods at the technical level;the validity evaluation of vocational competence evaluation method not only pays attention to the validity of the evaluation tool itself,but also pays attention to the evaluation of the validity of evaluation results and their use;the validity evaluation of vocational competence evaluation method is based on evidence-based validity argument;the constructed validity framework has good application value and generalizability.It is suggested that,the reliability and validity theory should be used as the theoretical basis when designing vocational competence evaluation methods,the impact of the use of evaluation and its results on candidates,colleges and enterprises should be paid attention to,the participation of stakeholders and the fairness of the evaluation should be focused on when designing the evaluation method.