一种大数据时代海量数据抽取的开发模型研究

Big data era development model research of huge amounts of data extraction

随着大数据增长速度提高、数据体量增大,数据的冗余也将会越来越大,传统的数据软件分析模型已经不能满足需要海量信息的处理和分析的需要,如何从大数据里面抽取有效的信息,对数据进行有效的分析和决策,建立新的数据模型,对数据进行分析和处理就显得尤为重要。采取了一种更适合大数据时代的数据抽取模型,并给出了数据抽取的判定方法。此方法具有复杂度低,易于实现,具有良好的估计性能。

With the big data＇s growth speed and its quantity increasing, data＇s redundancy will be more serious. So the traditional data software analysis model can＇t satisfy the need of mass information＇s processing and analysis. So it＇s especially important that how to get useful information from mass information, how to analyze data and how to set up new data model to analyze and process data. This passage used a data extraction mode which was very suited to big data era, and it applied the way of how to judge data extraction. This method has advantages of less difficulty, easier to realize and a good estimated performance.