Scoring and Consequential Validity Evidence of Computer-and Paper-Based Writing Tests in Times of Change

Little is known about how the assessment modality,i.e.,computer-based(CB)and paper-based(PB)tests,affects language teachers’scorings,perceptions,and preferences and,therefore,the validity and fairness of classroom writing assessments.The present mixed-methods study used Shaw and Weir’s(2007)sociocognitive writing test validation framework to examine the scoring and consequential validity evidence of CB and PB writing tests in EFL classroom assessment in higher education.Original handwritten and word-processed texts of 38 EFL university students were transcribed to their opposite format and assessed by three language lecturers(N=456 texts,152 per teacher)to examine the scoring validity of CB and PB tests.The teachers’perceptions of text quality and preferences for assessment modality accounted for the consequential validity evidence of both tests.Findings revealed that the assessment modality impacted teachers’scorings,perceptions,and preferences.The teachers awarded higher scores to original and transcribed handwritten texts,particularly text organization and language use.The teachers’perceptions of text quality differed from their ratings,and physical,psychological,and experiential characteristics influenced their preferences for assessment modality.The results have implications for the validity and fairness of CB and PB writing tests and teachers’assessment practices.

Reliability and Validity Test of Questionnaire on the Adaptation Strategy of Cryosphere Changes in Arid Inland River Basin

[Objective] The aim was to test the reliability and validity of questionnaire on the adaptation strategy of cryosphere changes in arid inland river basin. [Method] A questionnaire on 'the adaptation strategy of cryosphere changes in arid inland river basin' was carried out in Urumchi River basin and Aksu River basin, and its reliability and validity were tested by means of statistical method, so as to investigate the stability and accuracy of questionnaire. [Result] Reliability analysis of questionnaire showed that the split-half reliability coefficient of questionnaire in Urumchi River basin and Aksu River basin was 0.729 and 0.750, respectively, and Cronbach’s α reliability coefficient was 0.613 and 0.616, respectively, which revealed that the questionnaire had good equivalence and internal consistency which reflected good reliability and stability. According to validity analysis on questionnaire, there was significant correlation between the score of most questions and questionnaire, and it indicated that questionnaire had high content validity. There were 8 common factors collected from 26 questions, which were summarized as agricultural planting, agricultural water conservation, life satisfaction, cultivated land variation, social integration sense, climate and cryosphere changes, capital input improved by environment and family economic condition, respectively. Meanwhile, the contribution rate of various questions in corresponding indexes was higher, and reflected structure was in full accord with questionnaire content, which revealed that questionnaire owned good construct validity. [Conclusion] With higher stability and accuracy, the questionnaire could determine the desired topic and content and was suitable for the study on the perception of common people and choices of adaptive strategy under cryosphere changes in arid inland river basin in northwestern China.

Test-Retest Reliability, Convergent Validity and Practice Effects of the RBANS in a Memory Clinic Setting: A Pilot Study

This pilot study examined the psychometric properties and clinical utility of a brief neuropsychological instrument (Repeatable Battery for the Assessment of Neuropsychological Status (RBANS). The test-retest reliability, practice effects and convergent validity of RBANS were examined in participants without objective cognitive impairment. The tests were administered at two time points at approximately a two weeks’ interval, with 30 cognitively intact participants with a mean age of 63.3 ± 5.8 years. Adequate test-retest reliabilities were found for RBANS subtests, index and total scale scores with significant gain scores in immediate memory and visuospatial function. The RBANS showed good convergent validity and the RBANS supplemented with executive and language measures (Colour Trails Test and 30-item modified Boston Naming Test, respectively) demonstrated excellent convergent validity with a formal neuropsychological battery. This pilot study has provided the preliminary evidence of reliability and convergent validity of the RBANS. Additionally, it also provides insight on the practice effects so that clinicians may assess significant changes in RBANS subtests and domain indexes for clinical practice.

Interpretation of Key Concepts in Language Testing: Validity, Validation and Reliability

Language testing is an important link in language teaching,in this paper,the two important criteria of language test the reliability and validity has carried on the detailed elaboration,in order to a language teacher proposition and evaluation test more scientific.

Research on the Content Validity of the CET-4 Fast Reading Test

Content validity is an important part of language testing.In this paper,the content validity of the CET-4 fast reading test is analyzed in terms of expected response and text input.The result of final research shows that the content validity of the fast reading test is high with some limitations proposed.

On Reliability and Validity in Language Testing

This paper dwells on the two important factors-reliability and validity in language testing: explain the concepts of reliability and validity; factors influencing reliability and validity; possible ways to achieve high reliability and validity; comments on the modern language testing tendency on reliability and validity and authors' own ideas.

Concurrent Validity of a Virtual Version of Box and Block Test for Patients with Neurological Disorders

Background: The Box and Block clinical test is a validated and standardized scale for use in the clinical environment that allows the assessment of rough manipulative dexterity. Proposing virtual methods to carry out these assessments is an attempt to eliminate some of the subjectivity that the test may entail depending on the observer and the way in which the patient gives instructions. Applied to the assessment of skills after neurological pathologies, previous experiences in stroke patients have been found. So, this work was centered on the Spinal Cord Injury. Objective: To present the virtual application of the Box and Block scale, as well as details about its design and development for its manipulation based on Leap Motion Controller. Methodology: The relationship between the results obtained in the actual test and in the virtual application in healthy subjects and, mostly, patients with cervical spinal cord injury is analyzed, obtaining a high correlation index between both tests’ performance. Results: A high correlation index was obtained between both tests performance, the real and virtual version of the Box and Block Test. Conclusion: This virtual test can serve as an element to evaluate in the future the effectiveness of the RehabHand prototype based on virtual reality applications with a therapeutic and a rehabilitative sense that, manipulated from Leap Motion Controller, allow the improvement of the manipulative dexterity in patients with neurological diseases such as spinal cord injury.

Diagnostic Test Validity of Oxacillin Screen Agar for the Detection of Methicillin Resistant <i>Staphylococcus aureus</i>

Background: Detection of Methicillin Resistant Staphylococcus aureus may vary in phenotypic and genotypic methods. Objective: The aim of this present study was to validate the oxacillin screen agar test for the detection of methicillin-resistant Staphylococcus aureus isolated from clinical specimens. Methodology: This cross-sectional study was planned to carry out in the Department of Microbiology and Immunology at Bangabandhu Sheikh Mujib Medical University, Dhaka from January, 2010 to December, 2010 for a period of one (01) year. Different clinical specimens were collected from the patients presented with infections at anybody sites. Isolation and identification of Staphylococcus aureus (S. aureus) were performed by staining, culture and biochemical tests. Oxacillin screen agar test was performed to detect the methicillin-resistant Staphylococcus aureus. PCR was performed for detection of the mecA gene for MRSA. Result: Out of the 22 suspected MRSA isolates 19 were mecA positive by PCR. The sensitivity and specificity of oxacillin screen agar were 100.0% (95% CI 82.3 to 100.0%) and 33.3% (95% CI 24.0 to 90.6%) respectively. The positive predictive value and negative predictive value of oxacillin screen agar test were 90.5% (95% CI 81.0 to 95.5%) and 100.0% (95% CI 20.6 to 100.0%) respectively. The accuracy of the oxacillin screen agar test was 90.9% (95% CI 71.7 to 96.3%). Conclusion: In conclusion oxacillin screen agar test has high sensitivity with low specificity for the detection of MRSA.

Diagnostic Validity of Cica Beta Test 1 for the Detection of Extended Spectrum Beta-Lactamase (ESBL) Producing Gram Negative Bacteria by Comparing with Phenotypic Method

Background: Detection of extended spectrum beta lactamase producing bacteria is an important issue in the clinical settings. Objective: The purpose of the present study was to validate the Cica Beta Test 1 for detection of extended spectrum beta-lactamase (ESBL) producing bacteria. Method: This analytical type of cross-sectional study was carried out in the Department of Microbiology and Immunology at Bangabandhu Sheikh Mujib Medical University (BSMMU), Dhaka from January 2006 to December 2006 for a period of one (01) year. All the patients presented with the clinical features of urinary tract infection and surgical as well as burn wound infection at any age with both sexes were selected as study population. All bacteria were isolated and identified by their colony morphology, staining characters, pigment production, motility and other relevant biochemical tests. Phenotypic confirmation of ESBLs producing isolates were done by inhibitor potentiated disc diffusion test according to CLSI recommendation. The Cica Beta Test 1 was performed according to the manufacturer’s instructions. Result: A total number of 288 Gram negative bacteria were isolated. Among these isolates Cica Beta test 1 was positive in 97 strains and phenotypic confirmatory test was positive in 89 strains. The test sensitivity of Cica Beta Test 1 was 100% (95% CI 95.9% to 100.0%). Specificity of the test was 96.0% (95% CI 92.2% to 98.2%). The positive predictive value (PPV) and negative predictive value (NPV) were 92.7% (95% CI 84.5% to 95.7%) and 100.0% (95% CI 98.0% to 100.0%) respectively. The accuracy of the test was 97.2% (95% CI 95.1% to 99.1%). Area under ROC curve = 0.980 (95% CI 0.964 to 0.996);p value 0.0001. Conclusion: In conclusion, Cica Beta Test 1 is very high sensitivity and specificity for the detection of ESBL from Gram negative bacteria.

Reliability and Content Validity of a Comprehensive Discourse Completion Test of Interlanguage Pragmatics for Academic Situations

The present study aimed at investigating the reliability and content validity of a comprehensive test of Interlanguage Pragmatics （ILP） developed for the academic situations in the Iranian context. To do so, a meta-analysis of 50 articles which had reported on the tests of ILP was done and the criteria required for the selection of the speech acts of academic situations were developed. Then a Multiple-Choice Discourse Completion Test （MDCT） of interlanguage pragmatics was developed and validated through native checked situations and items based on meta-pragmatics procedures. Participants of the study were 50 M.A. students majoring in TEFL （Teaching English as a Foreign Language） studying at Iranian universities as well as 50 native speakers of English. The findings revealed that the test developed enjoyed high internal consistency and content validity. The present findings could contribute to the fields of second language testing and assessment in general and testing interlanguage pragmatics in particular.

TESTING THE VALIDITY OF Ar/Ar SINGLE-CRYSTAL WHITE MICA AGES FOR EROSION, EXHUMATION AND PROVENANCE STUDIES:RECENT SEDIMENTS FROM THE GANGA RIVER, NORTH INDIA

Detrital white mica single\|crystal Ar\|Ar ages from the Himalayan foreland sedimentary record are potentially a powerful tool in constraining source regions, tectonic evolution, and the timing and extent of exhumation (Copeland 1990, Najman 1997, White 1999). However such studies require large numbers of analyses, and Ar/Ar total\|fusion of white mica grains is a very rapid and cost\|effective technique.Such analyses, however, do result in the sacrifice of internal consistency checks inherent in, for example, Ar/Ar step\|heating analysis.

On Validity of English Tests in Vocational Schools

In this paper, I want to talk about my experience of English testing in vocational schools and share my ideas about the relations between English teaching and testing in vocational schools so that a better way of testing English may be carried out in vocational schools.

Infectious Disease Update in Obstetrics: A Modern Approach to the Patient with a Positive Screening Test for Syphyilis in Pregnancy

Screening for maternal syphilis has been an essential component of routine antenatal screening tests in most countries for many years. This is not only because of the virulence of the spirochete which causes the infection but also because of its vertical transmission rate and the potential severe adverse complications/morbidity that can result from its transmission to the fetus. Although the incidence of maternal syphilis and its fetal sequalae in low-income countries has been considerable for several years, the disease has been almost non-existent in high income countries with wide antenatal screening coverage and effective treatment programmes for Syphilis. The recent alarming increase in the incidence of maternal syphilis in high income countries has spawned a renewed public health interest in the infection, with several countries updating and strengthening public health guidance in an attempt to stem this dramatic trend. This is a short clinical update for the practising obstetrician on how to manage the antenatal patient with a positive syphilis screening test.

Discuss the Concepts of Authenticity and Validity in Relation to the IELTS Listening Test

These days there is an increasing amount of research about the International English Language Testing System(IELTS)and the individual sections, while the presentation of a sort of testing concepts is also valuable to explore. After completing necessary practice, candidates seem capable of getting high scores in the listening section. It is interesting to examine the relationship between an individual part of test and the relevant testing concepts. The discussion in this essay is based on the explanation of the nature of the IELTS listening test and the analysis of separate components in the test. It is found that to some extent the IELTS listening test could present a certain testing principles, while different researchers or test takers are possibly to have various understanding of the concepts and the further research is required. The most apparent finding, which was pointed out in the final part of this essay is that the IELTS listening test focus on assessing a specific field of knowledge.

The Analysis of Validity in English Language Testing——A Comparison Between FCE and SQA Test in Listening

Language testing plays an important role in language education,which will reflect the efficiency of language learning di?rectly.Among the various types of language testing,this paper is to make a comparison between two proficiency tests,FCE and SQA,in listening section,analysing their validity from three aspects:the mode of delivery,texts of the test and the statements of the tasks.

College English Test: Reliability, Validity and Washback Effect

The intent of this paper is to evaluate College English Test(CET)’s reliability,validity and washback effect in the con⁃text of language assessment by applying Brown’s framework of test usefulness.The result of literature review and discussion shows that CET’s student-related reliability and rater reliability for writing section are unfavorable while its test administration reliability and rater reliability for CETSET has been increasing;CET’s content and construct validity are getting improved but its criterionrelated validity has been violated due to students’inappropriate learning attitude;CET’s negative washback has been caused due to the overemphasis on passing rate,but previous surveys shows positive washback in teaching and learning as students’reading and oral communication abilities have been improved.In the end,three suggestions for CET’s development are summed up:empha⁃sis less on test result;inform students with the significance of CET’s reform;the relationship among testing,teaching and learning should be built into a mutual promotion format.

An Empirical Study on the Reliability and Validity of English Tests

The paper makes a study on six parts, namely, speaking, writing, sentence, cloze, reading and listening in an English test with students at two different proficiency levels. Their score data were studied through reliability analysis, validity analysis, factor analysis and analysis of variance ( ANOVA) to conduct the validation of this English test. The paper tries to explore the score data internal consistency, group difference recognition to maintain the objectivity and accuracy in English tests.

Discussion on the Importance of Reliability and Validity in Language Testing

When talked about the language testing, we need to focus on the reliability and validity,the paper explains the importance of reliability and validity and why should we focus on them when we make language testing paper. Also list various factors that affect reliability and validity.

Comparison of Type I Error Rates of Siegel-Tukey and Savage Tests among Non-Parametric Tests

This study aimed to examine the performance of the Siegel-Tukey and Savage tests on data sets with heterogeneous variances. The analysis, considering Normal, Platykurtic, and Skewed distributions and a standard deviation ratio of 1, was conducted for both small and large sample sizes. For small sample sizes, two main categories were established: equal and different sample sizes. Analyses were performed using Monte Carlo simulations with 20,000 repetitions for each scenario, and the simulations were evaluated using SAS software. For small sample sizes, the I. type error rate of the Siegel-Tukey test generally ranged from 0.045 to 0.055, while the I. type error rate of the Savage test was observed to range from 0.016 to 0.041. Similar trends were observed for Platykurtic and Skewed distributions. In scenarios with different sample sizes, the Savage test generally exhibited lower I. type error rates. For large sample sizes, two main categories were established: equal and different sample sizes. For large sample sizes, the I. type error rate of the Siegel-Tukey test ranged from 0.047 to 0.052, while the I. type error rate of the Savage test ranged from 0.043 to 0.051. In cases of equal sample sizes, both tests generally had lower error rates, with the Savage test providing more consistent results for large sample sizes. In conclusion, it was determined that the Savage test provides lower I. type error rates for small sample sizes and that both tests have similar error rates for large sample sizes. These findings suggest that the Savage test could be a more reliable option when analyzing variance differences.

Reliability and Validity of the English Oral Test

English oral test aimsto provide a fair and valid measure of a testee'soral proficiency so asto give an accurate description of his/her oral communicative ability.This paper analysesthe validity and reliability of the college entrance English oral test paper of Guangdong province of 2005.In designing an oral test,in order to make the test reliable,the teacher should take the following factors into consideration:test content,test method,testees'mood,rating scales and rater characteristics.