Ordinate与SpeechRater口语自动评分系统评述与启示被引量：14

A Critical Review of Two Automated Speech Scoring Systems: Ordinate & SpeechRater

导出

摘要口语自动评分系统是全自动口语考试的核心技术,为大规模口语考试的实施带来新契机。在口语自动评分领域,Ordinate与SpeechRater评分系统被公认为典型代表,但普通考生、教师乃至一些测试研发者对这一新生事物并不十分熟悉,甚至抱有误解。本文试从系统架构(语音识别、特征提取、分数计算)及评分质量视角对比评述两大系统,以期揭开口语自动评分过程的神秘面纱;并从系统与考试构念及任务的关系层面切入,评论两大系统带来的启示。 As the core technology of automatic spoken language tests, automated speech scoring system offers new opportunities for large-scale speaking assessments. Ordinate and SpeechRater have been widely accepted as the typical automated systems for scoring spoken responses. Despite their potential uses, relatively work has been done in the detailed introduction and critical review of the systems, and it is therefore not well understood by some test users and even developers and researchers. This paper outlines and evaluates the two systems in terms of their architecture （including speech recognition, feature extraction and score aggregation） and scoring quality. It also examines the implications of two systems for the design of spoken language tests and development of automated speech scoring systems in China.

作者罗凯洲韩宝成

机构地区北京外国语大学中国外语教育研究中心北京外国语大学外国语言研究所

出处《外语电化教学》 CSSCI 北大核心 2014年第4期27-32,共6页 Technology Enhanced Foreign Language Education

基金教育部人文社科重点研究基地北京外国语大学中国外语教育研究中心2012年重大课题"高考英语考试改革研究:考试方案设计及效度论证"(编号DHA070148)

关键词口语考试自动评分系统构念定义任务设计 Speaking Assessment Automated Scoring System Construct Definition Task Design

分类号 H319.3 [语言文字—英语]

引文网络
相关文献

参考文献21

1Downey, R., Farhady, H. Present-Thomas, R., Suzuki, M. & A. Van Moere. Evaluation of the usefulness of the Versant for English test: A response [ J ]. Language Assessment Quarterly, 2008 (5).
2Chun, C. Comments on "Evaluation of the usefulness of the Versant for English test: A response": The author responds [ J ]. Language Assessment Quarterly, 2008 (5).
3Chapelle, C. Utilizing technology in language assessment [A ]. In E. Shohamy & N. nornberger (eds.). Eltcyclopedia of Language and Education, 2nd Edition,Volume 7: Language Testing and Assessment [ C ]. NY: Springer, 2008.
4Bernstein, J. , De Jong, J. , Pisoni, D. & B. Townshend. Two experiments on automatic scoring of spoken language proficiency[ A I. In P. Delcloque (ed.). Proceedings of INSTIL 2000: Integrating Speech Technology in Learning [ C ] , Scotland : University of Abertay Dendee, 2000.
5Van Moere, A. A psycholinguistic approach to oral language assessment [ J ]. Language Testing, 2012 (29).
6Bernstein, J. Computer scoring of spoken responses [ A 1. In C. Chapelle ( ed. ). The Encyclopedia of Applied Linguistics, Volume 2 [ C ]. MA: Blackwell Publishing Ltd, 2013.
7Luoma, S. Assessing Speaking [ M ]. Cambridge : Cambridge University Press, 2004.
8Xi, X. Automated scoring and feedback systems: Where are we and where are we heading? [ J ]. Language Testing, 2010 (27).
9Bernstein, J., Van Moere, A. & J. Cheng. Validating automated speaking tests[J]. Language Testing, 2010 (27).
10Xi, X. , Higgins, D. , Zechner, K. & D. Williamson. A comparison of two scoring methods for an automated speech scoring system[J]. Language Testing, 2012 (29).