1Conrad, D. Judging the judges: improving rater reliability at music contests [ M]. 2003. http://www. answers.com
2Wigglesworth, G. Exploring bias analysis as a tool for improving rater consistency in assessing oral interaction [ J ]. Language Testing, 1993,10 (3).
3Lumley,T. Aassessment criteria in a large - scale writing test:what do they really mean to the raters [ J ]. Language Testing. 2002, 3,246 -276.
4Brennan, R. L. C, eneralizability theory [ M]. New York: Springer - Verlag Inc, 2001.
5Brown, J. D. Questions and answers about language testing statistics : generalizability and decision studie [ J ]. Shiken: JALT Testing & Evaluation SIG Newsletter, 2005, 9( 1 ) ,12 - 16. http://www. answers.com.
6Bachman, L. F. and Palmer, A.(). The construct validation of the FSI oral interview [ J ]. Language Learning, 1981, 31,67 - 86.
7Kuang, D. C. & Steinberg, L. Assessing performance: investigation of the influence of item context using item response theory methods. Poster session presented at the Annual Meeting of the Society of Industrial and Organizational Psychology, 2004, Chicago,IL. 1 - 17.
5Lumley T and McNamara T F. Rater characteristics and rater bias: Implications for training [ J ]. Language Testing, 1995, 12:54-71.
6Tyndall B and Kenyon D M. Validation of a new holistic rating scale using Rasch multi-faceted analysis [ A ].In Cumming A and Berwick R ( eds. ). Validation in Language Testing [ C ]. Clevedon : Multilingual Matters,1996.
7Lynch B and McNamara T F. Using g-theory and many-facet Rasch measurement in the development of performance assessments of the ESL speaking skills of immigrants [ J]. Language Testing, 1998, 15 : 158 - 180.
8Weigle S C. Using FACETS to model rater training effects [ J]. Language Testing, 1998, 15:263 -287.
9Kondo-Brown K. A FACETS analysis of rater bias in measuring Japanese second language writing performance[J]. Language Testing, 2002, 19:3 -31.
10Bonk W J and Ockey G J. A many-facet Rasch analysis of the second language group oral discussion task [ J ].Language Testing, 2003, 20:89- 110.