大数据基准测试流程与测试工具

Test Process and Tools Introduction in Big Data Benchmarking

当前大数据产品和技术的发展非常迅速,市场中存在各种各样的商业版和开源的大数据软件,这些大数据系统解决了大数据大体量、多样性、时效性的挑战。随着大数据产品和技术成熟,如何去测试和评估这些大数据产品成为新的研究主题。文章简要介绍大数据兴起的背景,综述大数据处理系统的主要构成,并针对大数据处理系统的特点,提出构建大数据基准测试平台的要素和流程,最后介绍当前大数据基准测试工具和存在的问题,展望未来大数据基准测试工具的发展方向。

With the rapid development of big data products and technologies, many commercial and open sources big data softwares have emerged, which have solved the problems brought by big data. As big data products and technologies have become mature, how to test and evaluate the products is a new research topic. This paper brielfy introduces the background of big data and the main components of big data processing system. After studying the features of big data systems, the components of big data benchmark are discussed. Then the article expresses the methodology on the design of big data benchmark tool. At last, the current big data benchmark tools are introduced, folowed by a discussion about the problem and future direction of the big data benchmark tool.