FastQueue:一种高性能的磁盘队列存储管理机制

FastQueue:A High Performance Disk Queue Storage Management Mechanism

1.引言 随着消息通信(如消息、短消息)的爆炸式增长,消息传递系统的性能面临严峻的挑战.消息通信的首要特点是高可靠性,在发送人确认消息收到之前必须将消息保存到磁盘上.

High reliability is the primary requirement for messaging system. Messaging system always utilizes disk queue to temporarily store message to be delivered. Experiments show that Disk queue I/O is the primary performance bottleneck in the messaging system. In this paper we present a high performance disk queue storage management mechanism-FastQueue. The FastQueue utilizes a large file to serve as disk queue to reduce file manage overhead, in which adjacent messages are stored in adjacent disk block. Several messages are written to disk queue in a one large write by Lazy Gathering Write. Several adjacent messages are read into buffer in a one read by Sequential Grouping Prefetch. The Lazy Gathering Write and Sequential Grouping Prefetch policies take full advantage of the disk bandwidth. Experiment shows that performance of the FastQueue is more than an order of magnitude higher than that of traditional disk queue.