海量邮件分布式文件系统的设计与实现

Design and Implementation of a Distributed File System for Massive E-MAILS

本文通过归纳分析已有的分布式系统体系结构,研究并设计了一个针对于海量邮件存储的分布式文件系统。受Google File System架构的启发,针对单个元数据服务器带来的瓶颈问题,提出了多个元数据服务器的解决方案。针对邮件写入格式的特殊性和数据源的多样性,设计并实现了多数据源的相同接口的写入支持,并对写入文件的格式进行压缩和添加sync字段,使整个系统具有更好的I/O性能以及更好的数据完整性。

Through summarizing and analyzing existing architecture of distributed file system, a distributed file system dedicated to massive e-mail＇s accessing is studied and implemented. Inspired from Google file system, a multiple Meta-data server solution is proposed to tackle the bottleneck problem of a single Meta-data server. A writing-in support for the same interface of diverse data sources is designed and implemented to handle the special nature of e-mail writing-in format and the diversity of data sources. Through addition of sync field and compression of the format of file being written-in, a better I/O performance and better integrity of the data are achieved of the whole system.