摘要
随着集群搭建的高性能计算中心快速发展,海量数据处理中CPU和内存的速度已经有了质的飞跃,但是I/O部分的速度仍是制约整个系统性能的瓶颈。本论文目的在于通过深入研究流媒体系统的特性,来提取出一种高效、均衡的文件存储分配策略,增大服务并行度并且减小服务延时。首先对媒体文件进行特征评估,然后通过存储调度器进行磁盘间的均衡性平摊,进而应用更细粒度的分划,做到每个磁盘内部的存储分布优化。仿真结果验证了算法的有效性,这样的分配策略可使盘间、盘内在数据组织上更为合理,有效的提高了并行服务能力,提供了更加迅捷的用户体验。
With the development of high performance center build on server cluster, the speed of CPU and Memory have gained a big leap in massive data processing, but the unmatched I/0 speed is still a bottleneck of whole system. This paper digs into streaming media system＇s specific characters deeply in order to fred out a more efficient, balanced way of file storage distribution, increasing degree of parallelism while reducing service time delay. First, give an evaluation of each media file based on target features, then distribute all files onto different disks through storage scheduler, finally there is a fme grit division to guarantee storage inside one disk is highly optimized. The simulation results verify the validity of the algorithm, this strategy of storage allocation not only improves data organization among disks, but also works well in one disk, which brings a better concurrent service and user experience.
出处
《计算机系统应用》
2010年第12期44-48,共5页
Computer Systems & Applications
基金
国家高技术研究发展计划(863)重大专项(2008AA01A317)
安徽省高校自然科研项目(KJ2008A106)
关键词
流媒体系统
存储分配
均衡性平摊
并行服务
streaming media system
storage distribution
balanced divide
concurrent service
