英语作文自动评分及其效度、信度与可操作性探讨被引量：13

Review of the System of Automated Essay Scoring and Discussion of Its Reliability,Validity and Operability

下载PDF

导出

摘要评述国内外作文自动评分系统,并依据英语作文测试中的信度、效度和实践可操作性对其进行分析。探讨国内英语作文自动评阅系统的发展,在肯定其优点的同时,指出和分析其中的问题和不足,并提出相应之对策,以期为我国英语作文自动评阅系统研发提供借鉴和启迪。 Reviewing AES tools abroad and in China,this paper studies them according to reliability,validity and operability.Different from previous research,this paper introduces and explores the recent development of AES in China.While affirming their benefits,the paper points out the deficiencies and analyzes the problems.It also offers countermeasures with the purpose of providing the study and development of AES in China with reference and enlightenment.

作者谢贤春

机构地区茂名学院外国语学院

出处《江西师范大学学报（哲学社会科学版）》 2010年第2期136-140,共5页 Journal of Jiangxi Normal University(Philosophy and Social Sciences Edition)

关键词作文自动评阅英语写作信度效度可操作性 automated essay scoring English writing reliability validity operability

分类号 H319.3 [语言文字—英语]

引文网络
相关文献

参考文献22

1Sheimis,M.D.& Burstein,J.Automated Essay Scoring:A Cross-disciplinary Perspective[M],Mahwah,NJ:Lawrence Erlbaum Associates,2003.
2Hamp-Lyons,Liz.Fourth Generation Writing Assessment[A].In Tony Silva(ed.).On Second Language Writing[C].Mahwah,NJ:Lawrence Erlbaum Associates,2001.
3葛诗利,陈潇潇.中国EFL学习者自动作文评分探索[J].外语界,2007(5):43-50. 被引量：34
4Page,E.B.Project Essay Grade:PEG[A].In M.D.Shermis & J.Burstein(eds.).Automated Essay Scoring:Across-disciplinary Perspective[C].Mahwah,NJ:Lawrence Erlbaum Associates,2003.
5Kukich,K.Beyond Automated Essay Scoring[A].In Hearst,K.(ed.).The Debate on Automated Essay Scoring[C].Los Alamitos,CA:IEEE Intelligent Systems,2000.
6Dodigovic,M.Artificial Intelligence in Second Language Learning:Raising Error Awareness[M].Clevedon:Multilingual Matters Ltd,2005.
7Dikli,S.An Overview of Automated Scoring of Essays[J].The Journal of Technology,Learning and Assessment,2006,(1).
8Yang,Y.,Buckendahl,C.W.,Juszkiewicz.P.J.& Bhola,D.S.A Review of Strategies for Validating Computer AutomatedScoring[J].Applied Measurement in Education,2002,(4).
9Ben-Simon,A.& Bennett,R.E.Toward More Substantively Meaningful Automated Essay Scoring[J].Journal of Technolo-gy,Learning and Assessment,2007,(1).
10Foltz,P.W.Latent Semantic Analysis for Text-based Research[J].Behavior Research Methods,Instruments and Comput-ers,1996,(2).

二级参考文献59

1Burstein J. The e-rater scoring engine : Automated essay scoring with natural language processing [ A ]. In Shermis M D & Burstein J (eds.). Automated Essay Scoring: A Cross-disciplinary Perspective [ C ]. Mahwah, NJ : Lawrence Erlbaum Associates, 2003. 113 - 122.
2Burstein J & Chodorow M. Automated essay scoring for nonnative English speakers [ EB/OL ]. http ://www. ets. org/Media/Research/pdf/erater_ac199rev. pdf, 1999 - 06/2006 - 03 - 20.
3Burstein J, Chodorow M & Leacock C. Criterion Online Essay Evaluation : An Application for Automated Evaluation of Student Essays [ EB/OL]. http://citeseer, ifi. unizh. ch/cache/papers/cs/28192/http:zSzzSzwww. ets. orgzSzresearchzSzdloadzSziaai03bursteinj, pdf/burstein03criterion. pdf, 2003/2006 -03 -20.
4Dikli S. Automated essay scoring [ J ]. Turkish Online Journal of Distanee Education, 2006, 7 (1) :49 -62.
5Elliot S. IntelliMetric: From here to validity [ A ]. In Shermis M D & Burstein J (eds.). Automated Essay Scoring: A Cross-disciplinary Perspective [ C]. Mahwah, N J: Lawrence Erlbaum Associates, 2003. 71 -86.
6Fohz P W, Gilliam S & Kendall S A. Supporting content-based feedback in online writing evaluation with LSA [ J ]. Interactive Learning Environments, 2000, 8 ( 2 ) : 111 - 129.
7Keith T Z. Validity of Automated Essay Scoring Systems [ A]. In Shermis M D and Burstein J (eds.). Automated Essay Scoring: A Cross-disciplinary Perspective [ C ]. Mahwah, NJ: Lawrence Erlbaum Associates, 2003. 147 - 168.
8Kukich K. Beyond Automated Essay Scoring [ A ]. In Hearst M A ( ed. ). The debate on automated essay grading [J]. IEEE Intelligent Systems, 2000, (5) :27 -31.
9Landauer T K & Dumais S T. A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge [ J ]. Psychological Review, 1997, ( 104 ) : 211 - 240.
10Landauer T K, Laham D & Foltz P W. Automated essay scoring and annotation of essays with the intelligent essay assessor [ A]. In Shermis M D & Burstein J (eds.). Automated Essay Scoring: A Cross-disciplinary Perspective [ C]. Mahwah, NJ: Lawrence Erlbaum Associates, 2003. 87- 112.