Validity and Reliability of a Mental Health Recovery Checklist for Young Adults

The purpose of the present study is to evaluate the internal consistency and construct validity of a self-report checklist measuring clinical mental health recovery across six key domains:family and relationships,occupation and school,physical health,mental health,spirituality,and social support systems.The Mental Health Recovery Checklist(MHRC)was developed at The Dorm,an intensive outpatient mental health treatment program for young adults in New York,NY,and Washington DC that services individuals between the ages of 18 and 35 years old.The present study is cross-sectional,as data were pulled from clients’records who were discharged between January 2018 and May 2023.Pearson Correlations and Cronbach’s alpha were used to determine scale reliability.To establish validity,an Exploratory Factor Analysis(EFA)was conducted to assess a single-factor model using Principal Axis Factoring.Cronbach’s alpha was high(α=0.88),indicating good reliability.In the EFA,all items loaded strongly on a single factor.The unidimensional structure revealed in the EFA highlights the interconnected nature of various life domains as they pertain to mental health recovery in young adults.Future research is warranted to explore whether there are additional dimensions of mental health recovery that have not been assessed in the present scale.

Validity,Reliability,and Measurement Invariance of the Thai Smartphone Application-Based Addiction Scale and Bergen Social Media Addiction Scale

Background:In recent years,there has been increased research interest in both smartphone addiction and social media addiction as well as the development of psychometric instruments to assess these constructs.However,there is a lack of psychometric evaluation for instruments assessing smartphone addiction and social media addiction in Thailand.The present study evaluated the psychometric properties and gender measurement invariance of the Thai version of the Smartphone Application-Based Addiction Scale(SABAS)and Bergen Social Media Addiction Scale(BSMAS).Method:A total of 801 Thai university students participated in an online survey from January 2022 to July 2022 which included demographic information,SABAS,BSMAS,and the Internet Gaming Disorder Scale-Short Form(IGDS9-SF).Results:Confirmatory Factor Analyses(CFAs)found that both the SABAS and BSMAS had a one-factor structure.Findings demonstrated adequate psychometric properties of both instruments and also supported measurement invariance across genders.Moreover,scores on the SABAS and BSMAS were correlated with scores on the IGDS9-SF.Conclusion:The results indicated that the SABAS and BSMAS are useful psychometric instruments for assessing the risk of smartphone addiction and social media addiction among Thai young adults.

Validity and reliability of the Polish version of the Michigan Neuropathy Screening Instrument

BACKGROUND Diabetic sensorimotor polyneuropathy is an important risk factor for foot ulceration and amputation.Thus,patients with diabetes should be screened for this disorder according to local guidelines.An obstacle to the diagnosis of this disease may be the lack of unified diagnostic criteria due to the lack of properly validated scales used for assessment.AIM To validate both sections(A and B)of the Michigan Neuropathy Screening Instrument(MNSI)in Polish(PL)patients with diabetes.METHODS A cross-sectional study using a test(A1,B1)and re-test(A2,B2)formula was performed in 80 patients with diabetes.The gold standard used for neuropathy detection was a nerve conduction study(NCS)which was performed in all participants.Reliability of the MNSI-PL was assessed using the Cronbach’s alpha,Kuder-Richardson formula 20(KR-20),split-half reliability,the Gottman split-half tests,and correlation between first and second half was accessed.Stability was assessed using an intraclass correlation coefficient(ICC).For external validation,we used simple linear correlation,binomial regression,and agreement between two different tools using a Bland-Altman plot analysis.RESULTS The scale was internally consistent(Cronbach’s alpha for the full scale:0.81 for A and 0.87 for B).MNSI-PL scores in test/retest showed high stability(ICC=0.73 for A and ICC=0.97 for B).The statistically important correlations between MNSI-PL and NCS were found for B1,B2,and A1(P<0.005).The cut-off points of≥3 for section A(sensitivity of 90%-100%;specificity of 33%-40%)and≥2 for section B(sensitivity of 81%-84%;specificity of 60%-70%)were obtained during neuropathy detection.CONCLUSION The MNSI-PL is a reliable and valid instrument in screening for diabetic neuropathy.

Scoring and Consequential Validity Evidence of Computer-and Paper-Based Writing Tests in Times of Change

Little is known about how the assessment modality,i.e.,computer-based(CB)and paper-based(PB)tests,affects language teachers’scorings,perceptions,and preferences and,therefore,the validity and fairness of classroom writing assessments.The present mixed-methods study used Shaw and Weir’s(2007)sociocognitive writing test validation framework to examine the scoring and consequential validity evidence of CB and PB writing tests in EFL classroom assessment in higher education.Original handwritten and word-processed texts of 38 EFL university students were transcribed to their opposite format and assessed by three language lecturers(N=456 texts,152 per teacher)to examine the scoring validity of CB and PB tests.The teachers’perceptions of text quality and preferences for assessment modality accounted for the consequential validity evidence of both tests.Findings revealed that the assessment modality impacted teachers’scorings,perceptions,and preferences.The teachers awarded higher scores to original and transcribed handwritten texts,particularly text organization and language use.The teachers’perceptions of text quality differed from their ratings,and physical,psychological,and experiential characteristics influenced their preferences for assessment modality.The results have implications for the validity and fairness of CB and PB writing tests and teachers’assessment practices.

Reliability and validity of the hidden hunger assessment scale in China-revised for high school students

Objective:Hidden hunger remains a severe public health problem that affects millions of people worldwide.In China,challenges related to dietary imbalance and hidden hunger persist.Micronutrient inadequacy deserves more attention among adolescents,given its vital role in their growth and development;however,this problem appears to have been largely ignored.High school students,in particular,are often at a high risk of hidden hunger but have limited assessment tools available.Therefore,this study aims to revise the hidden hunger assessment scale for high school students(HHAS-HSS)in China and assess its reliability and validity.Methods:Based on a literature review,expert consultation,pre-experiment,and formal survey,a hidden hunger assessment scale was revised for high school students.The formal survey involved 9336 high school students in 11 of the 16 cities in Anhui Province,China,and 9038 valid questionnaires were collected and included in the analysis.The item analysis,internal consistency reliability,test-retest reliability,content validity,exploratory factor analysis,and confirmatory factor analysis of the HHAS-HSS were examined.Results:The HHAS-HSS included a total of 4 dimensions and 12 items:"vegetables and food diversity"(three items),"fruits and dairy products"(three items),"micronutrient-dense foods"(four items),and"health condition and eating habits"(two items).The results showed a Cronbach's alpha of 0.758,a split-half reliability of 0.829,and a test-retest reliability of o.793,indicating good internal consistency.Using the Bartlett's test and Kaiser-Meyer-Olkin test(KMO)to test the exploratory factor analysis presented a four-factor model of the HHAS-HSS,the KMO0 value was 0.820(P<0.001),which indicated the possibility for factor confirmatory factor analysis.Using the maximum variance rotation method,four factors were obtained,and the cumulative variance explained rate was 57.974%.Confirmatory factor analysis also supported the division of the scale into four dimensions,and the fitting indices were x^(2)=1417.656,x^(2)/df=29.534,goodness-of-fit index=0.974,adjusted goodnessof-fit index=0.958,parsimonious goodness-of-fit index=0.600,normed fit index=0.938,incremental fit index=0.940,Tucker-Lewis index=0.917,comparative fit index=0.939,and root mean square error of approximation=0.056.Except for x^(2)/df,all the indices reached the fitting standard,and the above results showed that the construct validity of the scale reached an acceptable level.Conclusions:The HHAS-HSS has good validity and reliability for Chinese high school students.It is a convenient self-report measure of hidden hunger risk.

Psychological impact of cancer scale:Turkish validity and reliability study

BACKGROUND In the diagnosis and treatment of cancer,it is important to evaluate the components of psychological adjustment.Considering the key role of nurses in providing care to patients,it is important to evaluate patients,to determine highrisk patients and to use tools with acceptable validity and reliability to develop care plans.AIM To analyze the Turkish validity and reliability of The Psychological Impact of Cancer Scale(PICS).METHODS This methodological study was conducted with 257 cancer patients admitted to the oncology-haematology clinic and outpatient clinic of a University Hospital between February and October 2021.After the translation process of the scale,content and construct validity were conducted.Exploratory factor analysis(EFA)and confirmatory factor analysis(CFA)was examined with construct validity,while item analyses and internal consistency analysis were conducted for reliability.RESULTS Analyses and assessment results showed that the content validity index of the scale was 0.96.In the exploratory factor analysis of the Turkish adaptation study,total variance rate explained was found as 84.98%.Factor loads of all items were between 0.82 and 0.94.It was found that Cronbach Alpha values were between 0.860 and 0.930 and total scale Cronbach Alpha value was 0.844.EFA and CFA showed that Turkish form of 12-item and 4-factor.The Psychological Impact of Cancer Scale was confirmed with no changes to the original scale.CFA revealed good fit indices.CONCLUSION Turkish PICS is a valid and reliable measurement tool for the evaluation of individual’s psychological response to cancer diagnosis and treatment and for being used in clinical practice.

Validity and reliability of the evaluation tool of TCM confidence in students with TCM learning experience

Objective:This study aimed to design an evaluation scale of traditional Chinese medicine(TCM)confidence and then evaluate its validity and reliability.Methods:Three parallel samples with TCM learning experience were included in this current study.Randomly selected 500 nursing students were included factor analysis and reliability and validity analyses.After 4 weeks,200 nursing students were recruited to retest the reliability.The evaluation tool of TCM confidence included 6 dimensions and 25 entries.Results:Cronbach's a coefficient of the evaluation scale was 0.95 and that of the 6 observed aspects were higher than 0.90,and splithalf reliability was 0.81.For the retest reliability,Cronbach's a coefficient of the evaluation scale was 0.93 and that of the 6 examined aspects was all over 0.80.The index of content validity Scale Content Validity Index(S-CVI)was 0.92 and Item Content Validity Index(I-CVI)was 0.83–1.00.Conclusions:Observed results may indicate that the designed tool can be used to assess the TCM confidence level of students with TCM studied experience and also can evaluate results of TCM education during studying TCM lectures.

Validity and Reliability of the Preference for and Tolerance of the Intensity of Exercise Questionnaire among Chinese College Students

The rising prevalence of physical inactivity is in all age groups(e.g.,in college students)a major public health issue as not meeting the recommended minimum amount of regular physical activity is linked to adverse health events.Vice versa,there is mounting evidence that achieving the recommended amount of regular physical activity is a vital element to prevent chronic diseases,but there is often an insufficient adherence to planned and structured forms of physical activity(i.e.,physical exercises).In this context,there is a large body of evidence indicating that exercise adherence is,among other factors,influenced by exercise-related affective responses.The Preference for and Tolerance of the Intensity of Exer-cise Questionnaire(PRETIE-Q)has been developed to measure these affective responses(e.g.,to specific exercise inten-sities).So far,no validated Chinese version of the PRETIE-Q has been available in the literature.To address this gap in literature,the present study developed and validated a Chinese version of the PRETIE-Q in a large sample of Chinese college students.Data from a total of 1117 college students were collected for analyses concerning factorial validity and construct validity.The re-test reliability was established using a sample of 150 randomly selected participants.In addition,the level of regular physical activity(PA),cardiorespiratoryfitness(CRF),and resilience were used to examine possible links with two domains(preference and tolerance)of the PRETIE-Q.Our results showed that a Chinese version of the PRETIE-Q has a goodfit and reliability(Cronbach’sαof 0.72 to 0.85 for preference and tolerance,respectively;ICC:r=0.72 of preference and r=0.67 of tolerance;fit indices:χ^(2)=21.612,df=19,p>0.05,TLI=0.997,CFI=0.998,RMSEA=0.016,SRMR=0.024).Secondly,positive associations of intensity-tolerance with PA,CRF,and resilience were observed.In summary,this study indicates that the Chinese version of the PRETIE-Q has sound psychometric properties and can be used in Chinese college students.The adapted version of the PRETIE-Q paves the way for further research on exer-cise-related affective responses in Chinese-speaking samples,although the generalizability of ourfindings needs to be established for other cohorts such as adolescents and older people with and without chronic diseases.

On Reliability and Validity in Language Testing

This paper dwells on the two important factors-reliability and validity in language testing: explain the concepts of reliability and validity; factors influencing reliability and validity; possible ways to achieve high reliability and validity; comments on the modern language testing tendency on reliability and validity and authors' own ideas.

Investigating the Reliability and Validity of Chen and Starosta's Intercultural Sensitivity Scale (ISS) against Chinese Cultural Background

Intercultural Communication Competence (ICC), as one of the research fields of intercultural communication, has been given much importance from scholars all around the world. Intercultural sensitivity is one of the three dimensions in Dr Chen's ICC model. This research investigates the reliability and validity of Chen and Starosta's Intercultural Sensitivity Scale (ISS) (2000) against Chinese cultural background by using Chinese university students majoring in English as respondents.

Interpretation of Key Concepts in Language Testing: Validity, Validation and Reliability

Language testing is an important link in language teaching,in this paper,the two important criteria of language test the reliability and validity has carried on the detailed elaboration,in order to a language teacher proposition and evaluation test more scientific.

Validity and Reliability of an English Test Paper in Junior Middle School

Test plays an important role in our lives in that it can cause backwash towards our teaching and learning.Thus the pur pose of the present study is to examine the quality of an English test paper in a junior middle school of Urumqi according to the language test theories.Through the data collection and analyses,the results indicate that the test paper is a medium-level test and the reliability is suitable.From the correlation analysis,we can see that each part has a high correlation value to the total,indicat ing that all of them contribute to generate language proficiency.

Discussion on the Importance of Reliability and Validity in Language Testing

When talked about the language testing, we need to focus on the reliability and validity,the paper explains the importance of reliability and validity and why should we focus on them when we make language testing paper. Also list various factors that affect reliability and validity.

Reliability and Validity of the English Oral Test

English oral test aimsto provide a fair and valid measure of a testee'soral proficiency so asto give an accurate description of his/her oral communicative ability.This paper analysesthe validity and reliability of the college entrance English oral test paper of Guangdong province of 2005.In designing an oral test,in order to make the test reliable,the teacher should take the following factors into consideration:test content,test method,testees'mood,rating scales and rater characteristics.

Validity and Reliability of Chinese Physical Activity Questionnaire for Children Aged 10-17 Years

Objective This study is aimed to report the development,the reliability and validity of the Chinese Children Physical Activity Questionnaire(CCPAQ)which was designed for the assessment of physical activity pattern in young population in China.Methods The CCPAQ was administered for two times in 119 children(mean age 13.1±2.4 years;boys 47%)to examine reliability by using intraclass correlation coefficients.Validity was determined in 106 participants by agreement with the CCPAQ measures and the objective method,the ActiGraph accelerometer.Data on physical activity patter n including time spe nt on d iff ere nt intensi ties and total physical activity,sedentary behavior as well as physical activity energy expenditure were used to assess the validity with Spearman's correlation coefficient and the Bland-Altman plots.Results The reliability coefficient of the CCPAQ ranged from 0.63-0.93(Intra-class correlation coefficient).Spearman's correlation coefficient for validity of time spent on total physical activity and sedentary behavior were all 0.32(P<0.001),and for physical activity energy expenditure was 0.58(P<0.001).Time spent on moderate-to-vigorous physical activity and light physical activity showed a relatively low correlation with the accelerometer(rho=0.20,P=0.040;rho=0.19,P=0.054).Conclusion The CCPAQ appears to be a promising and feasible method to assess physical activity pattern in Chinese children.

Food Frequency Questionnaire for Chinese Children Aged 12-17 Years: Validity and Reliability

Objective The primary objective of this study was to examine the validity and reliability of a semi-quantitative food frequency questionnaire(FFQ) among Chinese children aged 12-17 years. Methods A semi-quantitative 72-food item FFQ was developed for children aged 12-17 years. The reliability and validity of this FFQ were evaluated against 24-h dietary recalls(24 h DRs) to measure the consumption of foods and nutrients. We administered two FFQs and three DRs to children(N = 160) over a period of 1 month to evaluate the reliability and validity. Reliability was examined by quartile agreement and intraclass correlation coefficients(ICCs), and validity was examined by quartile agreement, Bland-Altman plots and correlation with DRs. Results For reliability, the ICCs between the two FFQs ranged from 0.21 to 0.76 for foods and nutrients, and the quartile agreement ranged from 70.0% to 95.0% in the same or adjacent quartiles. Spearman’s correlation coefficients of foods and nutrients between the second FFQ and the 24 h DRs ranged from-0.04 to 0.59. The Bland-Altman plots demonstrated good agreement across the range of intakes among nutrients. The quartile agreement ranged from 50.0% to 100.0%, with infrequent misclassification. Conclusion The FFQ assessment of dietary intakes demonstrated acceptable relative validity and high reproducibility for Chinese children aged 12-17 years.

Validity and reliability of Chinese version of Fatigue Impact Scale in cerebral infarction patients

BACKGROUND： Post-stroke fatigue has received much attention recently. Three evaluation scales are available, including the Fatigue Impact Scale （FIS）. Yet none of these has been proven to be of use in the evaluation of psychological quality after post-stroke fatigue. OBJECTIVE： To introduce FIS into China, and to evaluate the validity and reliability of the Chinese Version in patients with cerebral infarction. DESIGN： Scale evaluation. SETTING： Department of Rehabilitation, Beijing Friendship Hospital, Capital Medical University. PARTICIPANTS： A total of 330 patients with cerebral infarction were selected from the Department of Neurology, Beijing Friendship Hospital, Capital Medical University from June 2005 to December 2006. All patients met diagnostic standards from the Fourth National Cerebrovascular Disease Academic Meeting of China Medical Association and were diagnosed with CT or MRI examination. Patients who were not willing to accept scale evaluation were excluded. METHODS： The English version of FIS was translated into Chinese and subsequently translated back to English again. FIS was given to the discharged patients, and they returned them upon completion. In-patients completed and immediately returned the FIS. Validity and reliability of the retrieved scales were ascertained with descriptive and inference analysis. MAIN OUTCOME MEASURES： Total scores and subscale scores of FIS. RESULTS： Out of 330 questionnaires, 214 valid questionnaires were deemed valid in total. Six components were extracted in factor analysis, and the total cumulative contribution was 73.919%, which suggested the questionnaire was valid. After correlation analysis, 6 components were divided into 3 subscales, including cognitive, physical, and social, which was the same as the English version. The Cronbach α value for the three subscales was 0.937 7, 0.918 8, and 0.940 6, respectively （〉 0.7）. CONCLUSION： The reliability and validity of the Chinese version of FIS met with satisfaction and appeared to be adaptable to cerebral infarction patients in China.

The use of Career Growth Scale in Chinese nurses:Validity and reliability

Purpose:To test the validity and reliability of a modified Career Growth Scale(CGS)to assess nurse career growth.Method:A cross-sectional design was used to analyze the use of the CGS to survey 600 fulltime registered nurses from Grade A hospitals in Tianjin.Results:A modified scale we called Career Growth of Nurse Scale(CGNS)is acceptable,valid,and reliable for the evaluation of nurse career growth in Chinese hospitals.This scale measured three main factors(career goal,career capacity,and career opportunity)and showed that nurse career growth differed across age,work seniority,and professional title.Conclusions:A three-dimensional scale of nurse career growth was presented.The results revealed CGNS has good validity and reliability.

Validity and reliability of the Ocular Motor Nerve Palsy Scale

Objective and accurate assessment of the degree of ocular motor nerve palsy is helpful not only in the evaluation of prognosis, but also for the screening of treatment methods. However, there is currently no comprehensive measure of its severity. In this study, we designed the Ocular Motor Nerve Palsy Scale and investigated its validity and reliability. Six experts were invited to grade and evaluate the scale. The study recruited 106 patients with a definite diagnosis of unilateral isolated ocular motor nerve palsy. Three physicians evaluated the patients using the scale. One of the three physicians evaluated the patients again after 24 hours. The content validity index（CVI） and factor analysis were used to analyze the scale＇s construct validity. The intraclass correlation coefficient and Cronbach＇s alpha were used to evaluate the inter-rater and test-retest reliability and the internal consistency. The CVI results（I-CVI = 1.0, S-CVI = 0.9, Pc = 0.016, K＊ = 1） indicated good content validity. Factor analysis extracted two common factors that accounted for 85.2% of the variance. Furthermore, the load value of each component was above 0.8, indicating good construct validity. The Ocular Motor Nerve Palsy Scale was found to be highly reliable, with an inter-rater reliability intraclass correlation coefficient of 0.965（P 0.01）, a test-retest reliability intraclass correlation coefficient of 0.976（P 0.01）, and Cronbach＇s alpha values of 0.63–0.70. In conclusion, the Ocular Motor Nerve Palsy Scale with good validity and reliability can be used to quantify the severity of ocular motor nerve palsy. This study was registered at Chinese Clinical Trial Registry（registration number： Chi CTR-OOC-17010702）.

Reliability and Validity of Addiction Severity Index in Drug Users with Methadone Maintenance Treatment in Guizhou Province, China

Objective To evaluate the reliability and validity of the Chinese version of addiction severity index （ASI）-5th version （ASI-C-5）, in illegal drug users receiving methadone maintenance treatment （MMT） in China. Methods One hundred and eighty-six heroin addicts （144 men and 42 women） receivihg MMT at three clinics in Guizhou province, southwest China, were recmited. They were all interviewed with a questionnaire of ASI-C-5 and 35 were re-interviewed at an interval of seven days to assess its test-retest reliability. Results Cronbach＇s alpha for internal consistency of CSs varied from 0.60 to 0.81 in all domains. Test-retest reliability of composite scores （CSs） of ASI-C-5 were satisfactory （r=0.38-0.97）. Based on item analysis and expert＇s suggestions, five items were deleted and one item was modified in ASI-C-5. Criterion validity of ASI-C-5 was found acceptable, as compared to addicts＇ self-rating anxiety scale （SAS） and self-rating depression scale （SDS） （r=0.59 and 0.45） except for social support rating scale （SSRS）. Conclusions ASI-C-5 can be used for heroin addicts receiving MMT with acceptable reliability and validity.