基于工作流的气象超算作业调度应用研究

Application Research of Workflow-based Meteorological Job Scheduling on Super-computing

数值天气预报系统的运行涉及大量科学计算和复杂的流程控制,需要建立高效、稳定的自动化流程调度监控软件实施调度管理。对基于工作流的气象超算环境下的作业调度应用进行了研究,给出了三种基于气象超算的工作流环境建设方案和应用经验,阐述了结合超算平台的作业管理软件实现基于工作流的自动化作业运行调度的实现机制,总结提炼了工作流的设计原则。基于数值预报模式集成中试支撑平台的应用结果表明,基于工作流的流程化调度实现方案,可以高效地支持数值预报业务和科研应用的流程控制管理及监控。

The operational numerical weather forecast system involves a lot of scientific complex process control.It is necessary to build an efficient and stable automatic process scheduling monitoring system for management.The application of meteorological job scheduling in the super-computing environment based on workflow has been researched,which provides three construction schemes and application experience.The mechanism of how to realize the of automatic job scheduling based on workflow with the job queuing system of super-computing and workflow design principles has been explained.The application result on the integrated numerical prediction model pilot platform shows that the workflow based process scheduling implementation can effectively support the process control management and monitoring of numerical prediction operation and scientific research.