CorsairFS:一种面向校园网的分布式文件系统

CorsairFS: A Distributed File System for Campus Network

描述了CorsairFS——一种针对校园网和企业内部网设计的专用分布式文件系统.通过采用可扩展的架构、分块存储方式和基于注册、汇报的自组织机制,系统在满足性能和吞吐量指标的前提下,具有更好的可扩展性和可管理性,能够提供同一数据的多种不同视图,允许在不移动数据的情况下对目录结构进行重构.系统针对大量用户的数据共享和存储的工作负载进行了优化,能有效地处理大量小文件的并发访问,并通过实验说明其能够更有效地利用存储空间,提供更好的数据传输性能,特别是面对大量小文件的情况.

The Corsair file system （CorsairFS）, a scalable distributed file system for data sharing and online storage in campus network or intranet, is proposed. Adopting scalable architecture, chunk-based storage,and register/heartbeat mechanism, both the system scalability and manageability are improved. And decoupling the data storage and metadata management, the CorsairFS facilitates the arbitrary reorganization of the namespace, and supports multiple different data view for users. The experimental results demonstrate that the system can use the storage spaces more efficiently and achieve better transfer performance, especially for the cases with large number of small files.