基于Hadoop的大数据用户行为分析系统

Research and design of user behavior data analysis system based on Hadoop

通过对大量相关用户行为分析资料进行分析总结,对用户行为日志产生和使用过程进行了详细分析。通过构建Hadoop平台,使用HDFS分布式文件系统对海量日志进行存储,结合B/S架构和Java技术,同时引入MapReduce计算模式,完成了基于Hadoop的用户行为数据分析系统设计。按照功能模块设计了系统的测试用例,并测试了其实现情况。测试结果表明,所设计的基于Hadoop的用户行为数据分析系统完成了用户行为分析功能,而且具有良好的可靠性。

Through studying user behavior based on a large number of related data, the production and using process of the user behavior log is analyzed. By building the Hadoop platform and using the Hadoop distributed file system to store massive logs, combining with B/S architecture and Java technology, and introducing graphs calculation mode, the design of the user behavior data analysis system is completed based on Hadoop. A test case is designed according to the function module and its implementation is tested. The test results show that the designed user behavior data analysis system based on Hadoop has implemented the required functions in the requirements analysis, and has good validity and reliability.