一种混合云场景下面向对象存储的数据分流聚合方法

In a Hybrid Cloud Scenario a Data Diversion and Aggregation Method for OBS

利用开源的云计算技术构建一套适用于大型集团型企业的混合云场景下面向对象存储的数据分流和聚合技术,以统一对象存储PaaS服务的形式向业务端提供一种能安全接入的具有多样性源数据的交互场景。该方法采用云原生S3协议对异构对象存储服务进行重定义的封装、解析和转发控制,实现通过统一服务调度完成混合异构场景下面向对象存储的数据存取交互、复制迁移、定制化分层和汇聚合并加载等。该方法已在某大型航运集团型企业的跨境租箱应用场景中应用,结果表明其能在混合异构对象存储的业务场景下高效实现安全、灵活和弹性的数据统一交互。

This paper focuses on how to build a set of data streaming and aggregation technologies suitable for large group enterprises to store data towards objects in a hybrid multi cloud scenario,providing business side secure access and diverse source data interaction scenarios in the form of unified object storage PaaS services;This method adopts the cloud native S3 protocol to redefine the encapsulation,parsing,and forwarding control of heterogeneous object storage services,achieving data access interaction,replication migration,customized data layering,aggregation,merging,and loading of object storage in mixed heterogeneous scenarios through unified service scheduling.This method has been applied in the cross-border container rental application scenario of a large shipping group enterprise,and the results have shown that it can efficiently achieve secure,flexible,and elastic data unified interaction capabilities in the business scenario of mixed heterogeneous object storage.