基于Hadoop的电商离线数据挖掘系统设计

Design of an Offline Data Mining System for E-Commerce Based on Hadoop

随着数据爆炸式增长,大数据技术得到广泛应用。Hadoop平台大数据处理技术得到长足发展,Hadoop为不同场景功能需求提供丰富的工具,电商行业积累的数据不断增多,如何处理好存储订单与仓库数据成为电商行业的重要问题。文章介绍了Hadoop平台与数据挖掘相关技术,提出电商离线数据挖掘处理系统方案。设计数据处理平台系统架构,完成电商公司订单数据的数据仓库(Extract Transform Load,ETL)和入库。

With the explosive growth of data,big data technology has been widely applied.The Hadoop platform's big data processing technology has made significant progress.Hadoop provides rich tools for different scenario functional requirements,and the e-commerce industry has accumulated more data.How to handle platform storage order and warehouse data has become an important issue in the e-commerce industry,and using big data driving force to make it a consensus new growth point.Research and introduce Hadoop platform and data mining related technologies,and propose an e-commerce offline processing system solution.Design a data processing platform system architecture to complete the ETL and warehousing of order data for e-commerce companies.