基于流计算大数据技术的通用实时信令数据处理平台解决方案

General Real-time Signal Data Processing Platform Solution Based on Steam Computing Analysis and Big Data Technology

为满足企业决策者低成本高效率的通过获取、分析用户各种行为实时产生的各类信令事件的要求,提出了Flume-ng+Kafka+Storm+Esper+ZooKeeper+Redis等流计算大数据技术的通用实时信令事件处理平台的解决方案。以流计算处理引擎作为底层支撑,采用分布式集群部署,支持多信令事件数据的接入、信令规则的创建与规则解析处理以及最终结果的实时输出,对企业的快速反应、风险控制、实时处理具有深远的意义。

In order to meet the needs of enterprise decision makers to obtain and analyze real-time event information with low cost and high efficiency,this paper presents a solution to the general users’real-time behavioral signaling event processing platform based on Flume-ng+Kafka+Storm+Esper+ZooKeeper+Redis and other stream computing big data technologies.This solution uses stream computing engine as the bottom support and distributed cluster deployment to support the access of multi-signaling data sources,the creation of signaling data rules,the parsing and processing of signaling data rules and the real-time output of result data.It is of far-reaching significance to the rapid response,risk control and real-time processing of enterprises.