A simple statistical model is proposed regarding the estimation of one’s overall performance in an MCQ examination along with the calculation of probability of obtaining a certain percentage of marks in the same. Usi...A simple statistical model is proposed regarding the estimation of one’s overall performance in an MCQ examination along with the calculation of probability of obtaining a certain percentage of marks in the same. Using the data obtained from the results of a sufficiently large number of mock examinations, conducted prior to the main examination, certain parameters quantifying one’s knowledge or preparation for the examination has been calculated. Based on those parameters, the probability of obtaining a certain percentage of marks has been computed using the theory of binomial probability distribution. The dependence of this probability function on various parameters has been depicted graphically. A parameter, called the performance index, has been defined in terms of the expectation value and standard deviation of marks computed from probability distribution. Using this parameter, a new parameter called the relative performance index has been defined. This index estimates one’s performance with respect to the best possible performance. The variation of relative performance index with respect to the preparation index has been shown graphically for different parameter values quantifying various aspects regarding the examination and the examinee.展开更多
Background: Multiple Choice Questions (MCQs) are well known and widely used assessment tool. They can be used to measure the different levels of educational outcomes: knowledge, understanding, judgment and problem sol...Background: Multiple Choice Questions (MCQs) are well known and widely used assessment tool. They can be used to measure the different levels of educational outcomes: knowledge, understanding, judgment and problem solving. Traditional MCQs (stand-alone MCQs) often are used as a tool for facts recall. Advantages of using Scenario-based questions (SBQs) include more focus on learning objectives and ability to assess higher levels of learning. Shifting to scenario-based questions can increase the level of difficulty and measure higher levels of cognition. Purpose: This study explores the current knowledge and overall awareness of the undergraduate teaching staff about the use and difficulties of scenario-based single-best answer, multiple-choice questions (SB-SBA-MCQs) in assessments of the basic medical sciences. Method: We used an e-Likert scale questionnaire to explore this issue. The questionnaire covered the current knowledge, experience of staff in writing (SB-SBA-MCQs), courses or postgraduate degrees they attended and difficulties they face or anticipate in writing (SB-SBA-MCQs). Results: The majority (86%) are familiar with courses or workshops related to MCQs writing and assessment in general, a small minority have not attended any. The majority (86%) had some experience in writing MCQs. Only, a small percentage have not tried writing this type of MCQs. Nearly 60% think it takes time to construct, the majority (96%) of those researched are in support of shifting to scenario-based MCQs in basic medical sciences. Conclusion: The study has shown most of the teachers of basic medical sciences are aware of and with good knowledge in (SB-SBA-MCQs). It also highlighted the importance and need for regular training courses and workshops on the same.展开更多
If tests are to provide an accurate measure of learners’ language abilities, examiners must minimize the influence of intervening factors such as response format. This article is to investigate the effects of two tes...If tests are to provide an accurate measure of learners’ language abilities, examiners must minimize the influence of intervening factors such as response format. This article is to investigate the effects of two test formats on Chinese EFL learners' performance in reading tests. The findings confirm that test-takers' performance on reading is significantly affected by test formats and language level. All groups perform better on MCQ (Multiple Choice Questions) than SAQ (Short Answer Questions). Both test format and language proficiency level have main effect but they do not have interactive effect. By paying more attention to these factors examiners will enhance the validity of their tests.展开更多
Reliability and validity are two criteria to evaluate whether a test paper is successful. This paper analyzes the vocabulary and structure MCQ (Multiple Choice Question) of National English Proficiency Competition for...Reliability and validity are two criteria to evaluate whether a test paper is successful. This paper analyzes the vocabulary and structure MCQ (Multiple Choice Question) of National English Proficiency Competition for Middle School Students (NEPCMSS) test in 2010, evaluating the reliability and content validity by using SPSS software. It is concluded that the 20 multiple choice questions are not difficult in terms of difficulty;the reliability is good but the content validity is not so satisfied.展开更多
Multiple- choice tests give students the opportunity to select responses to test questions from among a number of specific choice. This format is efficient and practical. Carefully designed multiple- choice questions ...Multiple- choice tests give students the opportunity to select responses to test questions from among a number of specific choice. This format is efficient and practical. Carefully designed multiple- choice questions can provide valid information about student's knowledge and their ability to reason logically and apply complex thinking processes to solve problems. In this paper, the author explore the advantages and disadvantages of MCQ tests and suggest some useful tips for writing MCQs , the aim is to give some suggestions for improvement and use them more efficiently in our teaching and testing.展开更多
In 2016, there is a reform of the TEM-4 cloze test, which changes from multiple choice cloze test toward banked cloze test. The study takes multiple choice cloze test in 2015 before reform and bank cloze test after re...In 2016, there is a reform of the TEM-4 cloze test, which changes from multiple choice cloze test toward banked cloze test. The study takes multiple choice cloze test in 2015 before reform and bank cloze test after reform in 2016 as research subjects, and research data are from true test results of 48 test-takers. The performance analysis was done by using FACETS(Version 2.7) and SPSS 19.0. This research aims at exploring the relationships between two different cloze forms and the differentiated performance of test-takers, and also testing reliability and validity of two cloze forms. Results show that multiple choice cloze test and banked cloze test have great difference on reflecting test-takers' English ability. Banked cloze test can better reflect test-takers' English ability if more items are added.展开更多
文摘A simple statistical model is proposed regarding the estimation of one’s overall performance in an MCQ examination along with the calculation of probability of obtaining a certain percentage of marks in the same. Using the data obtained from the results of a sufficiently large number of mock examinations, conducted prior to the main examination, certain parameters quantifying one’s knowledge or preparation for the examination has been calculated. Based on those parameters, the probability of obtaining a certain percentage of marks has been computed using the theory of binomial probability distribution. The dependence of this probability function on various parameters has been depicted graphically. A parameter, called the performance index, has been defined in terms of the expectation value and standard deviation of marks computed from probability distribution. Using this parameter, a new parameter called the relative performance index has been defined. This index estimates one’s performance with respect to the best possible performance. The variation of relative performance index with respect to the preparation index has been shown graphically for different parameter values quantifying various aspects regarding the examination and the examinee.
文摘Background: Multiple Choice Questions (MCQs) are well known and widely used assessment tool. They can be used to measure the different levels of educational outcomes: knowledge, understanding, judgment and problem solving. Traditional MCQs (stand-alone MCQs) often are used as a tool for facts recall. Advantages of using Scenario-based questions (SBQs) include more focus on learning objectives and ability to assess higher levels of learning. Shifting to scenario-based questions can increase the level of difficulty and measure higher levels of cognition. Purpose: This study explores the current knowledge and overall awareness of the undergraduate teaching staff about the use and difficulties of scenario-based single-best answer, multiple-choice questions (SB-SBA-MCQs) in assessments of the basic medical sciences. Method: We used an e-Likert scale questionnaire to explore this issue. The questionnaire covered the current knowledge, experience of staff in writing (SB-SBA-MCQs), courses or postgraduate degrees they attended and difficulties they face or anticipate in writing (SB-SBA-MCQs). Results: The majority (86%) are familiar with courses or workshops related to MCQs writing and assessment in general, a small minority have not attended any. The majority (86%) had some experience in writing MCQs. Only, a small percentage have not tried writing this type of MCQs. Nearly 60% think it takes time to construct, the majority (96%) of those researched are in support of shifting to scenario-based MCQs in basic medical sciences. Conclusion: The study has shown most of the teachers of basic medical sciences are aware of and with good knowledge in (SB-SBA-MCQs). It also highlighted the importance and need for regular training courses and workshops on the same.
文摘If tests are to provide an accurate measure of learners’ language abilities, examiners must minimize the influence of intervening factors such as response format. This article is to investigate the effects of two test formats on Chinese EFL learners' performance in reading tests. The findings confirm that test-takers' performance on reading is significantly affected by test formats and language level. All groups perform better on MCQ (Multiple Choice Questions) than SAQ (Short Answer Questions). Both test format and language proficiency level have main effect but they do not have interactive effect. By paying more attention to these factors examiners will enhance the validity of their tests.
文摘Reliability and validity are two criteria to evaluate whether a test paper is successful. This paper analyzes the vocabulary and structure MCQ (Multiple Choice Question) of National English Proficiency Competition for Middle School Students (NEPCMSS) test in 2010, evaluating the reliability and content validity by using SPSS software. It is concluded that the 20 multiple choice questions are not difficult in terms of difficulty;the reliability is good but the content validity is not so satisfied.
文摘Multiple- choice tests give students the opportunity to select responses to test questions from among a number of specific choice. This format is efficient and practical. Carefully designed multiple- choice questions can provide valid information about student's knowledge and their ability to reason logically and apply complex thinking processes to solve problems. In this paper, the author explore the advantages and disadvantages of MCQ tests and suggest some useful tips for writing MCQs , the aim is to give some suggestions for improvement and use them more efficiently in our teaching and testing.
文摘In 2016, there is a reform of the TEM-4 cloze test, which changes from multiple choice cloze test toward banked cloze test. The study takes multiple choice cloze test in 2015 before reform and bank cloze test after reform in 2016 as research subjects, and research data are from true test results of 48 test-takers. The performance analysis was done by using FACETS(Version 2.7) and SPSS 19.0. This research aims at exploring the relationships between two different cloze forms and the differentiated performance of test-takers, and also testing reliability and validity of two cloze forms. Results show that multiple choice cloze test and banked cloze test have great difference on reflecting test-takers' English ability. Banked cloze test can better reflect test-takers' English ability if more items are added.
