期刊文献+

遥感数据集群处理作业调度管理系统研究 被引量:6

Research on job schedule and management system for remote sensing data processing with cluster
下载PDF
导出
摘要 高性能遥感数据集群处理技术提高了遥感数据处理的速度和精度。作业调度管理是集群处理系统的核心组成部分,有助于提高系统的吞吐率和资源使用率。常用调度管理系统通用性强,但针对性差,自动化程度低,资源使用存在盲目性。针对遥感数据集群处理,基于集群作业调度管理系统Open PBS,提出一种最优资源自动分配的"双级调度策略";应用分层架构和面向服务的软件开发思想,采用ICE中间件的网络通信技术,使用XML格式作为数据交换模式,研究并实现C/S(Client/Server)架构的灵活、友好、高效的遥感数据集群处理作业调度管理系统。 The application of high performance computing cluster technology to remote sensing data processing is one solution to meet the requirements of real-or near-real-time and high-accuracy processing capabilities. Job sched- ule and management is an important component of cluster which is designed to improve the throughput rate and resource utilization rate of system. Low degree of automation, blindness of resource selection and short of feasibility is unavoidable in common schedule system. Aiming at remote sensing data cluster processing, based on open sources Portable Batch System(PBS), it develops a twin-stage scheduling strategy for resources assigned optimally and automatically. With the layered structure and service-oriented programming method, the job scheduling and management system for cluster-based remote sensing data processing system is C/S pattern which is communicated with ICE(Internet Communications Engine) middleware by XML(Extensible Markup Language) format data transmitting.
出处 《计算机工程与应用》 CSCD 2012年第25期77-82,共6页 Computer Engineering and Applications
基金 地理空间信息工程国家测绘局重点实验室经费资助项目(No.201013) 环保公益性行业科研专项(No.201109043)
关键词 双级调度策略 最优资源分配 遥感数据处理 集群 twin-stage scheduling strategy optimal resources assignment data processing of remote sensing cluster
  • 引文网络
  • 相关文献

参考文献10

  • 1赵宗弟,胡凯,胡建平.基于PBS的集群作业调度策略的设计与实现[J].计算机与数字工程,2006,34(11):123-127. 被引量:9
  • 2PB S : portable batch system[EB/OL]. [2011-09].http ://www. openpbs.org/.
  • 3Singhai A, Sane A, Campbell R.Quarterware for middle- ware[J].IEEE Computational Science and Engineering, 1998,5(2) :4-9.
  • 4尚尔凡,何川,都志辉.基于PBS的机群任务调度管理中间件的设计与实现[J].小型微型计算机系统,2004,25(6):1048-1051. 被引量:4
  • 5安喜峰.高性能计算集群管理系统与作业调度技术研究与实现[D].西安:西北工业大学,2005.
  • 6ICE[EB/OL]. [2011-09].http://www.zeroc.com/.
  • 7Arndt O, Freisleben B, Kielmann T, et al.A comparative study of online scheduling algorithms for networks of workstations[J].Arizona: Cluster Computing, 2000, 3 (2) : 95-112.
  • 8Yoo B S, Das C R.Good processor management=fast allocation + efficient scheduling[C]//Proceedings of Intl Conf on Parallel Processing, Bloomingdale, 1997.
  • 9李媛.集群作业管理中间件的研究与实现[D].北京:首都师范大学,2009.
  • 10Lifka D A.The ANL/IBM SP scheduling system[C]// Proceedings of IPPS' 95 Workshop: Job Scheduling Strategies for Parallel Processing.[S.1.] : Springer-Verlag, 1995 : 295-303.

二级参考文献10

  • 1张丽晓,袁立强,徐炜民.基于任务类型的集群调度策略[J].计算机工程,2004,30(13):63-64. 被引量:11
  • 2Ashish Singhai, Aamod Sane, Roy H.Campbell. Quarterware for middleware[C]. In:Proceedings of the 18th IEEE International Coference on Distributed Compliting System, Amsterdam, 1998:192-201.
  • 3PBS:Portable batch system[EB/OL].http://www.openpbs.org.
  • 4Ashish Singhai, Aamod Sane.Roy H.Campbell quarterware for middleware[C].In Mary Papakhian.Comparing Job-Management Systems:The Users perspective[J].IEEE Computational Science & Engineering, April-June 1998, 5(2):4-9.
  • 5叶庆华 肖利民 祝明发.机群作业管理系统的比较及其评价标准体系[J].南京大学学报,2001,.
  • 6M.Corbatto.An introduction to PORTABLE BATCH SYSTEM (PBS).Technical Report[EB/OL].Http://hpc.sissa.It/pbs/pbs.Htm1,2000
  • 7David B.Jackson,Heather L.Jackson,Quinn O.Snell.Simulation Based HPC Workload Analysis[J].IEEE,2001
  • 8Brett Bode,David M.Halstead,Ricky Kendall,Zhou Lei.The Portable Batch Scheduler and the Maui Scheduler on Linux Clusters.USDOE
  • 9Srividya Srinivasan,Rajkumar Kettimuthu.Characterization of Backfilling Strategies for Parallel Job Scheduling.ICPP,2002
  • 10叶庆华,梁毅,孟丹.一种简化的基于First-Fit的Backfilling调度策略——RB-FIFT[J].计算机工程与应用,2003,39(2):70-74. 被引量:6

共引文献12

同被引文献41

引证文献6

二级引证文献12

相关主题

;
使用帮助 返回顶部