分布式存储系统中高并发客户端的设计与实现

Design and Implementation of a Highly Concurrent Client in Distributed Storage Systems

BlueOcean是基于对象存储技术的大规模分布式存储系统,本文详细描述了该系统中高并发客户端的设计与实现.该高并发客户端基于FUSE(用户态文件系统)框架进行开发,既保证了通用性,也降低了软件开发和维护的难度;该客户端实现了大部分POSIX语义接口,支持现有的绝大部分应用软件在其上透明运行;同时该客户端采用事件驱动编程模型,相对于传统的同步客户端,提升了在多文件并发访问情况下的性能.测试表明,使用本文实现的高并发客户端输出BlueOcean存储系统时,随着并发访问文件数量的增多,系统总体的数据读写性能,元数据操作性能以及事务操作性能均有很显著的提升.

BlueOcean system is a large distributed storage system based on object-oriented Storage technology. This paper describes the design and implementation of a highly concurrent client in BlueOcean system. This highly concurrent client is developed based upon the FUSE framework, which guarantees the generality and reduces the difficulty on developing and maintenance. The client implements most POSIX interfaces, and it can support most existing application. In addition, the client is implemented using the eventdriven model. When accessed by multi applications simultaneously, the client improves the performance significantly comparing with the traditional synchronization client. The results of the experiments show that, when the BlueOcean storage system is outputted by the highly concurrent client, the data read/write performance, metadata operations performance and transactions performance of the overall system has a significant performance improvement.