基于知行一致性判定三角的需求维基协作效用评估方法

A Collaboration Effectiveness and Easiness Evaluation Method for RE-specific Wikis Based on Cognition-Behavior Consistency Decision Triangle

以维基百科为代表的维基技术,以其操作简便、利于远程协作成为众多领域关注的焦点.通过扩展各种开源维基工具,加强其协作功能,开发专用于支持分布式需求工程活动的维基型需求管理工具(简称为需求维基),也成为需求工程当前的研究热点之一.目前,已经存在诸如RE-Wiki、SOP-Wiki和WikiWinWin等众多此类工具,但如何度量、评估其协作效用,利用评估结果甄别用户反馈为工具演化提供指导还有待研究.文中基于知行一致性判定三角,提出了基于统计假设检验进行一致性判定的协作效用评估方法,从设计者设计预期、用户使用感知和用户行为表征三方面度量需求维基的协作效用.具体而言,通过构造设计者问卷和用户问卷获取设计者和用户对协作功能的设计预期和使用感知;通过在工具中植入用户无感知的行为监测模块,获取用户协作行为数据,并以此为基础制作专家问卷,获得用户行为的效用表征评价,从而进行知行一致性判定.案例研究表明,该方法对于发现设计者与用户间对于协作功能效用感知与行为的异同十分有效,统计分析结果能够用于甄别用户反馈,为工具演化决策提供客观依据.

Wiki technology, represented by Wikipedia, has attracted serious concern due to its capability to support collaboratively online contents＇ creation in a flexible and simple manner. Under the guidance of Wiki technology, developing specific wiki-based requirements management tools, namely RE-specific wikis, through extending various open source wikis to support distrib- uted requirements engineering activities becomes a hot research topic. Many RE-specific wikis, such as RE Wiki, SOP-Wiki and WikiWinWin, have been developed. But how to evaluate its col laboration effectiveness and easiness still needs further study. Based on Cognition-Behavior Con- sistency Decision Triangle （CBCDT）, a Collaboration Effectiveness and Easiness Evaluation Method （CE：~ M） ~or evaluating RE-specific wikis is proposed. As to a specific RE-specific wiki, it evaluates the consistencies from three aspects： the expectations of its designers, the cognitions of its users and the behavior significations of its users. Specifically, the expectations of its designers and the cognitions of users are got from investigation; the behavior significations are gained from experts＇ investigation according to their opinions on the statistical data of the users＇ collaboration behaviors. And then, the consistencies＇ evaluations based on statistical hypothesis testing are performed. Through the ,ease study, it shows that CEaM is appropriate to discover the similari- ties and differences among the expectations, cognitions and behaviors. These insights gained can be used as the objective evidences of RE-specific wiki＇s evolution decisions.