基于分布式网络爬虫的移动互联网用户行为分析系统研发

User Behavior Analysis System Based on Distributed Crawler

随着3G时代的到来,传统的移动运营分析模式存在的弊端日益明显:一方面由于用户手机终端对网络的访问日渐增多,传统的分析模式已经不足以完全反映用户行为画像的实际情况,无法准确定位用户行为喜好,从而无法做出精准营销;另外一方面,目前WAP网关中存在大量用户网络访问日志,此类数据没有被很好地加以挖掘,无法形成有效的用户知识,不管在用户分析还是客户营销支撑工作,都没有发挥其应有的效能。因此,建设移动互联网用户行为分析系统,通过网络爬虫及云计算平台的支撑手段挖掘WAP网络日志的用户知识,完善对用户的认知,在此基础上支撑精准营销工作。

With the coming of 3G, shortcomings in traditional analysis for business operation are increasingly obvious： As the acce.-,s to internet growing, the traditional mode cannot completely reflect the actual user＇ s behavior, cannot locate their preferences, and thus cannot make a precise marketing. On the other hand, there are many user network access logs in the WAP gateway, this data is not in a good use, whether analyzing or marketing. This article constructs an analysis system for internet behavior, based on crawler, WAP access logs, and cloud computing plalform. Improve the awareness of the users, and make more precise marketing support.