The use of multiple-choice(MC)question types has been one of the most contentious issues in language testing.Much has been said and written about the use of MC over the years.However,no attempt has ever been made to i...The use of multiple-choice(MC)question types has been one of the most contentious issues in language testing.Much has been said and written about the use of MC over the years.However,no attempt has ever been made to introduce any innovation in test item types.The researchers proposed a jumbled words test item(JW)based on cognitive science and deep learning principles,and addressed the feasibility of replacing the type of multiple-choice(MC)question with JW to meet the ongoing rapid development of language testing practice.Two research questions were proposed ad hoc,focusing on the co-relationship between JW and MC scores.RASCH-GZ was used to perform item analyses(Rasch,1960).The item difficulty parameters thus obtained were used to compare the two different test items.The sample data metric includes 40 Chinese participants.The findings revealed that correlation analysis revealed that the performance of the same group of subjects taking both JW and MC was not relevant(Pearson Corr=0).This is primarily due to the total elimination of guessing factors inherent in test-takers during JW test performance.Three factors were specified for the design of the JW test:compute program,test difficulty,and score acceptability.These all have three dimensions.Data collected through questionnaires were analyzed using EFA in SPSS V.24.0.KMOs(=0.867)were found to be approximately one and significance at 0.000(0.05),indicating that the construct of theuestionnaire thus designed has better validity for factor analysis.Three important conclusions were obtained,the implications of which could provide impetus for our testing counterparts to practice more precisely and correctly,potentially reshaping our overall language testing practice.Limitations and recommendations for future research were also discussed.展开更多
文摘The use of multiple-choice(MC)question types has been one of the most contentious issues in language testing.Much has been said and written about the use of MC over the years.However,no attempt has ever been made to introduce any innovation in test item types.The researchers proposed a jumbled words test item(JW)based on cognitive science and deep learning principles,and addressed the feasibility of replacing the type of multiple-choice(MC)question with JW to meet the ongoing rapid development of language testing practice.Two research questions were proposed ad hoc,focusing on the co-relationship between JW and MC scores.RASCH-GZ was used to perform item analyses(Rasch,1960).The item difficulty parameters thus obtained were used to compare the two different test items.The sample data metric includes 40 Chinese participants.The findings revealed that correlation analysis revealed that the performance of the same group of subjects taking both JW and MC was not relevant(Pearson Corr=0).This is primarily due to the total elimination of guessing factors inherent in test-takers during JW test performance.Three factors were specified for the design of the JW test:compute program,test difficulty,and score acceptability.These all have three dimensions.Data collected through questionnaires were analyzed using EFA in SPSS V.24.0.KMOs(=0.867)were found to be approximately one and significance at 0.000(0.05),indicating that the construct of theuestionnaire thus designed has better validity for factor analysis.Three important conclusions were obtained,the implications of which could provide impetus for our testing counterparts to practice more precisely and correctly,potentially reshaping our overall language testing practice.Limitations and recommendations for future research were also discussed.
