基于消息传递的跨编程语言异构数据计算架构研究

Research on Heterogeneous Data Computing Architecture Across Programming Languages Based on Message Passing

当前各大公司在数据采集、加工、分析领域仍有数据融合、数据拉通的安全保障要求,通常采用分布式计算的方式来解决,但仍然面临多方数据规范不统一、技术栈差异较大等问题。聚焦异构数据分布式计算框架研究,提出了一种基于消息传递的跨编程语言的异构数据计算架构,并在实际的数据环境中进行模拟测试,对实际应用效果进行验证,为后续再生产环境中的推广应用提供了全面的研究论述。

At present,major companies still have security requirements for data fusion and data pulling through in the fields of data acquisition,processing,analysis,the common method is to solve by distributed computing,but they still have to face issues such as inconsistent data specifications from multiple parties and significant differences in technology stacks.Focusing on the research of heterogeneous data distributed computing framework,it proposes a cross-programming language heterogeneous data computing framework based on message passing,and carries out simulation tests in the actual data environment to verify the practical application effect,which provids a comprehensive research discussion for the subsequent promotion and application in the reproduction environment.