关于大数据时代对传统统计学变革的思考

Thoughts on the Transformation of Traditional Statistics in the Age of Big Data

本文在大数据时代背景下,将统计学与大数据有机结合,剖析了大数据时代给统计学带来的变革,阐述了大数据为传统统计学带来的发展机遇。为了保持统计学旺盛的生命力,本文对统计学的发展提出了几点思考。大数据的产生对统计学具有划时代的意义,大数据以其价值性、多样性、大量性、高速性的特征弥补了统计学高成本、高误差的劣势,但这并不意味着统计学的时代结束了,我们对大数据的搜索、聚类、分类等还需要依赖统计学的方法,因此大数据离不开统计学。大数据时代的到来,提高了统计质量、降低了统计成本,使得统计学发挥作用的领域增大,并且使统计学科得以延伸,提高了统计学科在自然科学和社会科学中的地位,这是大数据给传统统计带来的机遇。在大数据时代,传统统计学也面临着挑战,要求其改变对样本的认识、改变对不确定性的认识、建立新的数据梳理与分类的方法、强化结构化数据与非结构化数据的对接、转变抽样调查的功能、结合归纳演绎法与推断演绎法、并重相关分析与因果分析以及结合统计思想与云计算技术。我们应该牢牢抓住大数据带来的机遇,积极应对挑战,将大数据与统计学有机地结合,在未来的科学发展过程中,保持统计学旺盛的生命力。

In the background of big data age,this paper combines statistics with big data,analyzes the changes that big data age brings to statistics,and expounds the development opportunities that big data brings to traditional statistics.In order to maintain the vitality of statistics,this paper puts forward some thoughts on the development of statistics.The generation of big data has epoch-making significance for statistics.Big data makes up for the disadvantages of high cost and high error of statistics with its value,diversity,abundance,and high speed,but this does not mean that the era of statistics is over.We also need to rely on statistical methods for large data search,clustering,classification,etc.,so large data can not be separated from statistics.The advent of the era of big data has improved the quality of statistics,reduced statistical costs,increased the fields in which statistics play a role,and extended statistical disciplines,improving the position of statistical disciplines in natural and social sciences.This is the opportunity that big data presents for traditional statistics.