网络测验中可靠性控制变量的完全因素不变性检验

Testing Factorial Invariance in Online Test Based on Realiablity Controling Variables

网络测验相对于传统测验最重要的问题是对被试答题时的情境与条件无法控制。通过对网络测验中被试是否有急事处理(无vs.有)、测试时的情绪体验(积极情绪vs.消极情绪)、噪音影响(无影响vs.有影响)以及测试场所(学校vs.其他地方)等情境变量进行完全因素不变性检验,实现网络测验可靠性控制的目的。以主观健康量表(SHC)为例,针对3 667名青少年(年龄14~26岁,M±SD=19.31±1.62),进行上述情境变量不同组别的SHC完全因素不变性检验。结果表明:是否有急事需要处理、答题时情绪体验、噪音影响、答题场所等完全因素不变性都在一定程度上不能成立,说明上述指标可以作为网络测验中可靠性控制变量。

With the prevalence of internet,the online test shows great advantage for psychological assessment,and would be likely to replace the paper and pencil test.During the process,the issue whether the online test has invariance with the paper and pencil test should be considered and solved.Compared with the traditional test,the online test is facing the challenge from the uncontrollable environment and condition in test.In order to control the reliability of the online test,the researchers need to test Factorial invariance as to the variables,such as,hurry or not,noise or not,mood in the test,testing place and so on.The study took the subjective health complaints（SHC）as an example,with the subjects of 3 667 adolescents and youths（age：14-26,M±SD=19.31±1.62）,to test SHC factorial invariance according to different groups as below：hurry（hurry vs.no-hurry）,noise（noise vs.non-noise）,mood in the test（positive mood vs.negative mood）,testing place（school vs.other place）.The results show that factorial invariance is untenable across the hurry group and no-hurry group or positive mood group and negative mood group or noise group and non-noise group or School group and other-place group.Therefore,different groups divided by variables above have inequivalent responses for subjective health,and these reliability controlling variables should be controlled as key interfering variables to keep a high reliability for online test.