基于消息通信的分布式系统最终一致性平台

Eventual consistency platform of distributed system based on message communication

在分布式系统中为了满足高性能和吞吐量,一般采用异步消息通信方式,但消息通信没有解决分布式事务不一致问题。针对这个问题,提出建立一致性保障平台,通过这个平台实现最终一致性。首先,使系统满足幂等性以及业务数据与消息生产消费记录强一致性;其次,建立消息监控机制,根据监控规则和消费生产消费记录,判定消息正常还是需要补偿操作或者幂等操作,从而保证分布式系统基于消息通信的最终一致;最后,在整个设计实现过程中采用关注点分离和横向切分的思想与工程化的方法,实现一致性保障平台。通过实验和分析证明比较得出,与异步消息通信相比,分布式消息通信性能更优越;一致性保障平台能及时发现不一致并由系统及时处理,实现最终一致,即可以完全保障系统最终一致性;而且该平台通过平台化的实现方式在应用中可以快速复用到数十个业务系统。由此得出一致性保障平台可以解决分布式交易系统事务最终一致性问题,不仅性能优越而且经济。

In order to meet the performance and throughput requirements of distributed systems, the asynchronous message communication is a common strategy. However, this strategy can not solve the consistency problem of the distributed system. In order to solve this problem, this paper proposed the establishment of consistency guarantee platform. Firstly, the system fulfilled idempotency and strong consistency between business data and message production/consumption records.Secondly, a message monitoring strategy was established. And it could be decided whether a message was correct or the compensation/idempotent operation was needed, according to the monitoring rules and production/consumption records, in order to realize the eventual consistency of the distributed system based on message communication. Lastly, the Separation of Concerns（SoC） and horizontal segmentation methods were adopted in design and realization of this platform. Experiments and analyses have shown the better performance of this distributed message communication, comparing to the asynchronous communication. This platform could timely check and handle the inconsistency and thus achieve the eventual consistency,i. e. the final eventual consistency of the whole system. Also the platform design could easily be adopted to multiply business systems, which means this platform is not only superior-performed but also economic.