Scoring and Consequential Validity Evidence of Computer-and Paper-Based Writing Tests in Times of Change

Little is known about how the assessment modality,i.e.,computer-based(CB)and paper-based(PB)tests,affects language teachers’scorings,perceptions,and preferences and,therefore,the validity and fairness of classroom writing assessments.The present mixed-methods study used Shaw and Weir’s(2007)sociocognitive writing test validation framework to examine the scoring and consequential validity evidence of CB and PB writing tests in EFL classroom assessment in higher education.Original handwritten and word-processed texts of 38 EFL university students were transcribed to their opposite format and assessed by three language lecturers(N=456 texts,152 per teacher)to examine the scoring validity of CB and PB tests.The teachers’perceptions of text quality and preferences for assessment modality accounted for the consequential validity evidence of both tests.Findings revealed that the assessment modality impacted teachers’scorings,perceptions,and preferences.The teachers awarded higher scores to original and transcribed handwritten texts,particularly text organization and language use.The teachers’perceptions of text quality differed from their ratings,and physical,psychological,and experiential characteristics influenced their preferences for assessment modality.The results have implications for the validity and fairness of CB and PB writing tests and teachers’assessment practices.

Surface and Content Validity of the Mentoring Function Scale for Novice Nurses

This study aimed to examine the surface and content validity of the Mentoring Function Scale for Novice Nurses, used to assess the mentoring of entry-level nurses, and to refine the scale items. In Study 1, six nurse education researchers, selected using convenience sampling, with five or more years of nursing experience and experience teaching novice nurses, were invited to an expert meeting in July 2015. A group interview was conducted that lasted approximately 120 minutes. Study 2 examined the content validity index. Between September and November 2015, we distributed a self-administered questionnaire survey to 11 participants selected by convenience sampling. The participants included five nurse education researchers with a minimum of five years of nursing experience and experience teaching novice nurses, as well as six clinical nurses with a master’s degree or higher. Finally, 81 questionnaire items were retained from the initial 125 items. The 81-item Mentoring Function Scale for Novice Nurses had higher content validity than the original scale. To further increase the scale’s applicability, future studies should assess its reliability, construct validity, and criterion-related validity.

Construction and Validity of Chinese Translation of the Universal Mental Health Literacy Scale for Adolescents

Background:In this study,the Universal Mental Health Literacy Scale for Adolescents(UMHL-A)was revised and tested for its reliability and validity in Chinese middle school students,thus establishing a useful tool for assessing the mental health of individuals in this occupation.Methods:Our sample comprised 1208 junior high school students(58.85%male),aged between 11 and 15 years old.The Chinese version of the scale includes a mental health attitude subscale and mental health knowledge subscale,including attitudes towards seeking help,attitudes related to stigma,general mental health knowledge,and knowledge about specific mental illnesses,encapsulated in a total of 17 items.A series of psychometric analyses such as exploratory factor analysis(EFA),confirmatory factor analysis(CFA),and internal consistency reliability estimation were carried out in this study.Results:The results of the CFA indicated that the two-factor model had an acceptable model fit(Attitude(UMHL-A Likert):χ^(2)/df=4.107;RMSEA=0.072;SRMR=0.045;TLI=0.932;CFI=0.954;Knowledge(UMHL-A T/F):χ^(2)/df=3.647;RMSEA=0.066;SRMR=0.044;TLI=0.923;CFI=0.945).The Cronbach’s alpha coefficient of subscales of the Chinese version UMHL-A were 0.80 and 0.78,respectively.Conclusion:In general,the Chinese version of the Universal Mental Health Literacy Scale for adolescents has good reliability and validity and can be used as a tool to measure the mental health literacy of Chinese adolescents.

Validity and Reliability of a Mental Health Recovery Checklist for Young Adults

The purpose of the present study is to evaluate the internal consistency and construct validity of a self-report checklist measuring clinical mental health recovery across six key domains:family and relationships,occupation and school,physical health,mental health,spirituality,and social support systems.The Mental Health Recovery Checklist(MHRC)was developed at The Dorm,an intensive outpatient mental health treatment program for young adults in New York,NY,and Washington DC that services individuals between the ages of 18 and 35 years old.The present study is cross-sectional,as data were pulled from clients’records who were discharged between January 2018 and May 2023.Pearson Correlations and Cronbach’s alpha were used to determine scale reliability.To establish validity,an Exploratory Factor Analysis(EFA)was conducted to assess a single-factor model using Principal Axis Factoring.Cronbach’s alpha was high(α=0.88),indicating good reliability.In the EFA,all items loaded strongly on a single factor.The unidimensional structure revealed in the EFA highlights the interconnected nature of various life domains as they pertain to mental health recovery in young adults.Future research is warranted to explore whether there are additional dimensions of mental health recovery that have not been assessed in the present scale.

Validity,Reliability,and Measurement Invariance of the Thai Smartphone Application-Based Addiction Scale and Bergen Social Media Addiction Scale

Background:In recent years,there has been increased research interest in both smartphone addiction and social media addiction as well as the development of psychometric instruments to assess these constructs.However,there is a lack of psychometric evaluation for instruments assessing smartphone addiction and social media addiction in Thailand.The present study evaluated the psychometric properties and gender measurement invariance of the Thai version of the Smartphone Application-Based Addiction Scale(SABAS)and Bergen Social Media Addiction Scale(BSMAS).Method:A total of 801 Thai university students participated in an online survey from January 2022 to July 2022 which included demographic information,SABAS,BSMAS,and the Internet Gaming Disorder Scale-Short Form(IGDS9-SF).Results:Confirmatory Factor Analyses(CFAs)found that both the SABAS and BSMAS had a one-factor structure.Findings demonstrated adequate psychometric properties of both instruments and also supported measurement invariance across genders.Moreover,scores on the SABAS and BSMAS were correlated with scores on the IGDS9-SF.Conclusion:The results indicated that the SABAS and BSMAS are useful psychometric instruments for assessing the risk of smartphone addiction and social media addiction among Thai young adults.

Validity and reliability of the Polish version of the Michigan Neuropathy Screening Instrument

BACKGROUND Diabetic sensorimotor polyneuropathy is an important risk factor for foot ulceration and amputation.Thus,patients with diabetes should be screened for this disorder according to local guidelines.An obstacle to the diagnosis of this disease may be the lack of unified diagnostic criteria due to the lack of properly validated scales used for assessment.AIM To validate both sections(A and B)of the Michigan Neuropathy Screening Instrument(MNSI)in Polish(PL)patients with diabetes.METHODS A cross-sectional study using a test(A1,B1)and re-test(A2,B2)formula was performed in 80 patients with diabetes.The gold standard used for neuropathy detection was a nerve conduction study(NCS)which was performed in all participants.Reliability of the MNSI-PL was assessed using the Cronbach’s alpha,Kuder-Richardson formula 20(KR-20),split-half reliability,the Gottman split-half tests,and correlation between first and second half was accessed.Stability was assessed using an intraclass correlation coefficient(ICC).For external validation,we used simple linear correlation,binomial regression,and agreement between two different tools using a Bland-Altman plot analysis.RESULTS The scale was internally consistent(Cronbach’s alpha for the full scale:0.81 for A and 0.87 for B).MNSI-PL scores in test/retest showed high stability(ICC=0.73 for A and ICC=0.97 for B).The statistically important correlations between MNSI-PL and NCS were found for B1,B2,and A1(P<0.005).The cut-off points of≥3 for section A(sensitivity of 90%-100%;specificity of 33%-40%)and≥2 for section B(sensitivity of 81%-84%;specificity of 60%-70%)were obtained during neuropathy detection.CONCLUSION The MNSI-PL is a reliable and valid instrument in screening for diabetic neuropathy.

An Adaptive Parameter-Free Optimal Number of Market Segments Estimation Algorithm Based on a New Internal Validity Index

An appropriate optimal number of market segments(ONS)estimation is essential for an enterprise to achieve successful market segmentation,but at present,there is a serious lack of attention to this issue in market segmentation.In our study,an independent adaptive ONS estimation method BWCON-NSDK-means++is proposed by integrating a newinternal validity index(IVI)Between-Within-Connectivity(BWCON)and a newstable clustering algorithmNatural-SDK-means++(NSDK-means++)in a novel way.First,to complete the evaluation dimensions of the existing IVIs,we designed a connectivity formula based on the neighbor relationship and proposed the BWCON by integrating the connectivity with other two commonly considered measures of compactness and separation.Then,considering the stability,number of parameters and clustering performance,we proposed the NSDK-means++to participate in the integrationwhere the natural neighbor was used to optimize the initial cluster centers(ICCs)determination strategy in the SDK-means++.At last,to ensure the objectivity of the estimatedONS,we designed a BWCON-based ONS estimation framework that does not require the user to set any parameters in advance and integrated the NSDK-means++into this framework forming a practical ONS estimation tool BWCON-NSDK-means++.The final experimental results showthat the proposed BWCONand NSDK-means++are significantlymore suitable than their respective existing models to participate in the integration for determining theONS,and the proposed BWCON-NSDK-means++is demonstrably superior to the BWCON-KMA,BWCONMBK,BWCON-KM++,BWCON-RKM++,BWCON-SDKM++,BWCON-Single linkage,BWCON-Complete linkage,BWCON-Average linkage and BWCON-Ward linkage in terms of the ONS estimation.Moreover,as an independentmarket segmentation tool,the BWCON-NSDK-means++also outperforms the existing models with respect to the inter-market differentiation and sub-market size.

Validity and Reliability of the Preference for and Tolerance of the Intensity of Exercise Questionnaire among Chinese College Students

The rising prevalence of physical inactivity is in all age groups(e.g.,in college students)a major public health issue as not meeting the recommended minimum amount of regular physical activity is linked to adverse health events.Vice versa,there is mounting evidence that achieving the recommended amount of regular physical activity is a vital element to prevent chronic diseases,but there is often an insufficient adherence to planned and structured forms of physical activity(i.e.,physical exercises).In this context,there is a large body of evidence indicating that exercise adherence is,among other factors,influenced by exercise-related affective responses.The Preference for and Tolerance of the Intensity of Exer-cise Questionnaire(PRETIE-Q)has been developed to measure these affective responses(e.g.,to specific exercise inten-sities).So far,no validated Chinese version of the PRETIE-Q has been available in the literature.To address this gap in literature,the present study developed and validated a Chinese version of the PRETIE-Q in a large sample of Chinese college students.Data from a total of 1117 college students were collected for analyses concerning factorial validity and construct validity.The re-test reliability was established using a sample of 150 randomly selected participants.In addition,the level of regular physical activity(PA),cardiorespiratoryfitness(CRF),and resilience were used to examine possible links with two domains(preference and tolerance)of the PRETIE-Q.Our results showed that a Chinese version of the PRETIE-Q has a goodfit and reliability(Cronbach’sαof 0.72 to 0.85 for preference and tolerance,respectively;ICC:r=0.72 of preference and r=0.67 of tolerance;fit indices:χ^(2)=21.612,df=19,p>0.05,TLI=0.997,CFI=0.998,RMSEA=0.016,SRMR=0.024).Secondly,positive associations of intensity-tolerance with PA,CRF,and resilience were observed.In summary,this study indicates that the Chinese version of the PRETIE-Q has sound psychometric properties and can be used in Chinese college students.The adapted version of the PRETIE-Q paves the way for further research on exer-cise-related affective responses in Chinese-speaking samples,although the generalizability of ourfindings needs to be established for other cohorts such as adolescents and older people with and without chronic diseases.

Reliability and validity of the hidden hunger assessment scale in China-revised for high school students

Objective:Hidden hunger remains a severe public health problem that affects millions of people worldwide.In China,challenges related to dietary imbalance and hidden hunger persist.Micronutrient inadequacy deserves more attention among adolescents,given its vital role in their growth and development;however,this problem appears to have been largely ignored.High school students,in particular,are often at a high risk of hidden hunger but have limited assessment tools available.Therefore,this study aims to revise the hidden hunger assessment scale for high school students(HHAS-HSS)in China and assess its reliability and validity.Methods:Based on a literature review,expert consultation,pre-experiment,and formal survey,a hidden hunger assessment scale was revised for high school students.The formal survey involved 9336 high school students in 11 of the 16 cities in Anhui Province,China,and 9038 valid questionnaires were collected and included in the analysis.The item analysis,internal consistency reliability,test-retest reliability,content validity,exploratory factor analysis,and confirmatory factor analysis of the HHAS-HSS were examined.Results:The HHAS-HSS included a total of 4 dimensions and 12 items:"vegetables and food diversity"(three items),"fruits and dairy products"(three items),"micronutrient-dense foods"(four items),and"health condition and eating habits"(two items).The results showed a Cronbach's alpha of 0.758,a split-half reliability of 0.829,and a test-retest reliability of o.793,indicating good internal consistency.Using the Bartlett's test and Kaiser-Meyer-Olkin test(KMO)to test the exploratory factor analysis presented a four-factor model of the HHAS-HSS,the KMO0 value was 0.820(P<0.001),which indicated the possibility for factor confirmatory factor analysis.Using the maximum variance rotation method,four factors were obtained,and the cumulative variance explained rate was 57.974%.Confirmatory factor analysis also supported the division of the scale into four dimensions,and the fitting indices were x^(2)=1417.656,x^(2)/df=29.534,goodness-of-fit index=0.974,adjusted goodnessof-fit index=0.958,parsimonious goodness-of-fit index=0.600,normed fit index=0.938,incremental fit index=0.940,Tucker-Lewis index=0.917,comparative fit index=0.939,and root mean square error of approximation=0.056.Except for x^(2)/df,all the indices reached the fitting standard,and the above results showed that the construct validity of the scale reached an acceptable level.Conclusions:The HHAS-HSS has good validity and reliability for Chinese high school students.It is a convenient self-report measure of hidden hunger risk.

Psychological impact of cancer scale:Turkish validity and reliability study

BACKGROUND In the diagnosis and treatment of cancer,it is important to evaluate the components of psychological adjustment.Considering the key role of nurses in providing care to patients,it is important to evaluate patients,to determine highrisk patients and to use tools with acceptable validity and reliability to develop care plans.AIM To analyze the Turkish validity and reliability of The Psychological Impact of Cancer Scale(PICS).METHODS This methodological study was conducted with 257 cancer patients admitted to the oncology-haematology clinic and outpatient clinic of a University Hospital between February and October 2021.After the translation process of the scale,content and construct validity were conducted.Exploratory factor analysis(EFA)and confirmatory factor analysis(CFA)was examined with construct validity,while item analyses and internal consistency analysis were conducted for reliability.RESULTS Analyses and assessment results showed that the content validity index of the scale was 0.96.In the exploratory factor analysis of the Turkish adaptation study,total variance rate explained was found as 84.98%.Factor loads of all items were between 0.82 and 0.94.It was found that Cronbach Alpha values were between 0.860 and 0.930 and total scale Cronbach Alpha value was 0.844.EFA and CFA showed that Turkish form of 12-item and 4-factor.The Psychological Impact of Cancer Scale was confirmed with no changes to the original scale.CFA revealed good fit indices.CONCLUSION Turkish PICS is a valid and reliable measurement tool for the evaluation of individual’s psychological response to cancer diagnosis and treatment and for being used in clinical practice.

Validity and reliability of the evaluation tool of TCM confidence in students with TCM learning experience

Objective:This study aimed to design an evaluation scale of traditional Chinese medicine(TCM)confidence and then evaluate its validity and reliability.Methods:Three parallel samples with TCM learning experience were included in this current study.Randomly selected 500 nursing students were included factor analysis and reliability and validity analyses.After 4 weeks,200 nursing students were recruited to retest the reliability.The evaluation tool of TCM confidence included 6 dimensions and 25 entries.Results:Cronbach's a coefficient of the evaluation scale was 0.95 and that of the 6 observed aspects were higher than 0.90,and splithalf reliability was 0.81.For the retest reliability,Cronbach's a coefficient of the evaluation scale was 0.93 and that of the 6 examined aspects was all over 0.80.The index of content validity Scale Content Validity Index(S-CVI)was 0.92 and Item Content Validity Index(I-CVI)was 0.83–1.00.Conclusions:Observed results may indicate that the designed tool can be used to assess the TCM confidence level of students with TCM studied experience and also can evaluate results of TCM education during studying TCM lectures.

Animal models of amyotrophic lateral sclerosis： a comparison of model validity

Animal models are necessary to investigate the pathogenic features underlying motor neuron degeneration and for therapeutic development in amyotrophic lateral sclerosis（ALS）. Measures of model validity allow for a critical interpretation of results from each model and caution from over-interpretation of experimental models. Face and construct validity refer to the similarity in phenotype and the proposed causal factor to the human disease, respectively. More recently developed models are restricted by limited phenotype characterization, yet new models hold promise for novel disease insights, thus highlighting their importance. In this article, we evaluate the features of face and construct validity of our new zebrafish model of environmentally-induced motor neuron degeneration and discuss this in the context of current environmental and genetic ALS models, including C9 orf72, mutant Cu/Zn superoxide dismutase 1 and TAR DNA-binding protein 43 mouse and zebrafish models. In this mini-review, we discuss the pros and cons to validity criteria in each model. Our zebrafish model of environmentally-induced motor neuron degeneration displays convincing features of face validity with many hallmarks of ALS-like features, and weakness in construct validity. However, the value of this model may lie in its potential to be more representative of the pathogenic features underlying sporadic ALS cases, where environmental factors may be more likely to be involved in disease etiology than single dominant gene mutations. It may be necessary to compare findings between different strains and species modeling specific genes or environmental factors to confirm findings from ALS animal models and tease out arbitrary strain-and overexpression-specific effects.

Validity Consideration in Designing an Oral English Test

To make oral test accurately reflect the actual English spoken ability of candidates and play its role in guiding and promoting the improvement of English learners in the teaching, we must ensure that the design of scientific questions, the feasibility and validity of judgments to make an accurate and fair measurement of testers' language ability.

Research on Content Validity of Reading Comprehensions in 2005 MET

This paper examines reading comprehensions in 2005 MET. Statistic analysis shows that the MET in 2005 have certain validity,but there are some problems existing in these tests. The paper lists the problems and suggests some methods. The writer hopes that test-designers can pay much attention to them so as to improve the tests quality.

Investigating the Reliability and Validity of Chen and Starosta's Intercultural Sensitivity Scale (ISS) against Chinese Cultural Background

Intercultural Communication Competence (ICC), as one of the research fields of intercultural communication, has been given much importance from scholars all around the world. Intercultural sensitivity is one of the three dimensions in Dr Chen's ICC model. This research investigates the reliability and validity of Chen and Starosta's Intercultural Sensitivity Scale (ISS) (2000) against Chinese cultural background by using Chinese university students majoring in English as respondents.

Validity Considerations in Designing an Oral English Test

Speaking is the main purpose and most important skill for second language learning.This paper reviews the important validity considerations in designing a test,such as face validity,content validity,on the basis of which the author analyzes the oral test paper for the postgraduate entrance interview in Shaanxi University of Technology,thus putting forward some methods to improve the test paper.

Validity Considerations in CET-4 Banked Cloze Construction

In order to assess college students'overall language proficiency,a new format,banked cloze,is included in the revised CET-4.Based on the previous studies on banked cloze in China,this paper discusses on how to construct highly valid CET-4 banked cloze in line with the revised CET Syllabus(2006).

Interpretation of Key Concepts in Language Testing: Validity, Validation and Reliability

Language testing is an important link in language teaching,in this paper,the two important criteria of language test the reliability and validity has carried on the detailed elaboration,in order to a language teacher proposition and evaluation test more scientific.

Research on the Content Validity of the CET-4 Fast Reading Test

Content validity is an important part of language testing.In this paper,the content validity of the CET-4 fast reading test is analyzed in terms of expected response and text input.The result of final research shows that the content validity of the fast reading test is high with some limitations proposed.

Validity and Reliability of an English Test Paper in Junior Middle School

Test plays an important role in our lives in that it can cause backwash towards our teaching and learning.Thus the pur pose of the present study is to examine the quality of an English test paper in a junior middle school of Urumqi according to the language test theories.Through the data collection and analyses,the results indicate that the test paper is a medium-level test and the reliability is suitable.From the correlation analysis,we can see that each part has a high correlation value to the total,indicat ing that all of them contribute to generate language proficiency.