基于Web Services的网格数据传输子系统

Grid Datatransfer Subsystem Based on Web Services

数据是网格环境中一类特殊的资源,它的流动、管理以及统一视图是网格系统的重要组成部分。该文分析数据的特点并设计实现一个基于FTP协议,支持多线程、断点续传、异常识别、连接维持以及第三方传输和"中转不落地传输"两种传输模式的数据传输子系统。该子系统提供了数据的动、静态部署能力,为在超级计算机和集群上运行作业提供数据支持,形成在各个网格资源上所部署的数据的统一视图,方便对数据的进一步操作。

Data is a kind of resources in grid environment, it has many differences with other resources. Its flow, management and uniform view play an important role in grid system. This paper analyzes the characteristic of data, designs and implements a grid datatransfer subsystem based on FTP protocol, which abets multithreading download, break point transfer, exception identify and connection maintain. Also the subsystem implements two transfer models which are ＂not landed＂ transfer model and third control transfer model. It not only offers grid the ability of deploying data, gives data help of running task with super computers and clusters, but also forms uniform data view of all data, making it convenient to take deeper work.