论增进调查问卷研究效度之新策略

On the New Strategy of Improving the Validity of Questionnaire Research

问卷研究效度是指问卷所获得的资料达成研究目的之程度。问卷的试测效度和问卷的测量效度是表达问卷研究效度的两个指标。以长期从事问卷研制的实践经验为基础,探索增进问卷研究效度之新策略:“目标树建构—题目导出与问卷研制—试测操控—反馈评估与对标修改”。(1)根据研究目的建构概念分析的目标树和溯因分析的目标树。(2)从目标树的末级目标导出问卷题目,结合被调查者的特点编撰题干和选项,自编与借用题目相结合。(3)应用实验和准实验效度理论,控制试测样本误差、试测安排的霍桑效应、区域文化差异、历史事件、情境污染等无关变量对问卷资料的影响,增进问卷的试测效度。(4)分别运用对标分析法和因素分析法评估问卷资料的内容效度和结构效度,并根据评估结果对标修改问卷题目。

The validity of a questionnaire study refers to the extent to which the data obtained from the study achieve the research objectives.There are two indicators that express the validity of a questionnaire:the trial validity of the questionnaire and the measurement validity of the questionnaire.Based on extensive experience in questionnaire development,a new strategy for enhancing the validity of questionnaire research is explored:“goal tree construction,items derivation and questionnaire development,trial control,feedback evaluation and benchmarking modification.”(1)Construct a target tree for conceptual analysis and a target tree for retrospective analysis based on research objectives.(2)Derive questionnaire items from the ultimate goals of the goal tree,compile stem questions and options based on the characteristics of the respondents,combining self-composed and borrowed items.(3)Apply quasi-experimental and experimental validity theory to control the influence of irrelevant variables such as trial sample error,Hawthorne effect of trial arrangement,regional cultural differences,historical events,and context contamination on questionnaire data,thus enhancing the trial validity of the survey questionnaire.(4)Use benchmark analysis and factor analysis methods to separately evaluate the content validity and structural validity of the questionnaire data,and modify the questionnaire items based on the evaluation results.