开源社区评审过程度量体系及其实证研究

Open Source Community Review Process Measurement System and Its Empirical Research

在开源社区中,不同开发人员提交的代码水平参差不齐,需要代码评审检查提交代码质量.决策者是代码评审的关键人物,审核提交代码,发现软件缺陷.代码评审情况会对开源软件质量产生影响,因此需要建立评审过程度量体系,了解代码评审情况,促进提高开源软件项目质量.现有的软件过程度量方法主要考虑提交代码和评审评论活动,缺乏考虑决策活动,难以充分度量人员的评审行为.引入决策者因素,提出了一个开源社区评审过程度量体系,包括评审活动指标和人员分布指标.评审活动指标包含评审次数、评审信息长度、评审代码改动行数以及评审时间.人员分布指标主要考虑改动者、评论者和决策者的比例和数量.然后,收集了3个热门开源项目数据,分析评审过程度量指标与软件缺陷数量的关系.通过实证研究分析发现:决策者数量,少改动、少评论、少决策者的比例等决策者相关指标和软件缺陷数量中等正相关.同时,与不考虑决策者的度量体系进行对比分析,发现含有决策者的度量体系与软件缺陷的相关性更高.实证研究结果验证了评审过程度量体系的有效性,说明增加决策者相关指标的必要性.

In the open source community,the code level of different developers varies,and code reviews are required to check the quality of the submitted code.Decision makers are the key persons in the code review,auditing the submitted code and finding software defects.Code reviews affect the quality of open source software.Therefore,it is necessary to establish code review process measurement system,understand the code review situation,and promote the quality of open source software projects.Existing software process measurement methods mainly consider code submission and review comments,but lack of consideration for decision making activities,and it is difficult to fully measure the review behavior.This study considers decision-maker factor,and proposes an open source community’s review process measurement system,including evaluation activity indicators and personnel distribution indicators.Review activity indicators include numbers of review,length of review information,number of lines that code changes,and review time.The personnel distribution indicators mainly consider the proportion and number of modifiers,commenters,and decision makers.Then,this study collects data from three popular open source projects and analyzes the relationship between evaluation process metrics and the number of software defects.Through empirical research and analysis,it is found that the number of decision-makers,the proportion of decision-makers with few changes,few comments,and few decision-makers are moderately positively correlated with the number of software defects.At the same time,compared with the measurement system without the decision maker,it is found that the measurement system with the decision maker has a higher correlation with software defects.The results of the empirical study verify the effectiveness of review process measurement system,and illustrate the necessity of adding relevant indicators for decision makers.