TDDS:基于虚拟集群系统的任务部署与调度

TDDS:Task Deployment and Scheduling Based on Virtual Cluster System

利用虚拟机的灵活性和快速部署能力,设计并实现了任务部署与调度系统(task deployment and dispatch system,TDDS).TDDS能够根据用户的需求,为用户的计算任务提供可以进行资源配置的集群计算环境,满足了用户对不同操作系统、不同应用程序和不同计算资源的需求.TDDS还使用了负载均衡策略,以提高物理集群资源的利用率.提出了两种虚拟机部署策略,用以加快虚拟集群部署的速度.TDDS尽量控制虚拟机系统镜像的大小和访问频率,以提高部署的效率.实验表明,TDDS系统能够快速灵活地部署用户所需要的计算环境和计算资源,负载均衡的调度策略也切实提高了物理集群处理任务的能力,提高了集群的使用率.

The traditional computer cluster is not easy for management. For example, it is hard to install the systems, lack of secure isolation of different users; it cannot construct the customized environment according to the requirement of applications and users etc. Virtual machines can be used to tackle all these problems. A system called TDDS（task deployment and dispatch system） based on virtual machines has been designed and implemented. TDDS can build up the running environment according to the requirement from users and applications. In addition, TDDS builds the automatic application deployment and schedule system as well as load balancing among physical servers in the cluster. The main contribution of this dissertation includes： 1） Two different virtual machine setup methods are proposed for speeding up the application deployment based on customized virtual machines. 2） The task deployment and schedule mechanism are designed and implemented based on the virtual machines. TDDS can construct the virtual environment for distributed applications and schedule the tasks on the virtual platform. 3） Several experiments have been conducted to test the effectiveness and efficiency of computing environment and resources customized for user applications. The experiments indicate that TDDS can do the task deployment and scheduling efficiently. The load balancing schemes can be used to improve the processing capability of physical clusters i.e. achieving the goal of improving the usage efficiency.