基于Kafka的跨节点消息队列容灾实践应用

Application of Cross-node Message Queue Disaster Tolerance Practice Based on Kafka

基于高并发、稳定性、生态良好考虑,中移互联网有限公司部门项目引入成熟工具实现Kafka消息的异地节点同步,并采用一种基于滑动时间窗口的同步延迟检测算法实现Kafka消息同步进度的检测,从而很好地实现跨节点同步过程中,消息队列同步延迟的检测。

Based on high concurrency,stability,and good ecological considerations,the departmental project of China Mobile Internet Co.,Ltd.introduces mature tools to achieve off-site node synchronization of Kafka messages,and adopts a synchronization delay detection algorithm based on the sliding time window to achieve the detection of the synchronization progress of Kafka messages,so as to well achieve the detection of synchronization delays of the message queue in the process of cross-node synchronization.