多任务数据采集系统的设计与实现

Design and Realization of Multi-task Data Acquisition System

知识图谱广泛应用在面向领域任务的智能系统,其首要任务就是快捷获取最新的领域数据构建知识图谱。本文针对领域数据采集问题,基于机器人流程自动化技术设计了支持数据定时采集、多任务并发处理的数据采集系统。该系统采用Django开发框架及Docker开发和部署,提供了任务监控和数据管理功能。

Knowledge graphs are widely used in domain-oriented intelligent systems,and its primary task is to quickly obtain the latest domain data to construct a knowledge graph.Aiming at the problem of field data acquisition,this paper designs a data acquisition system that supports timing data acquisition and multi-task concurrent processing based on robotic process automation technology.The system adopts Django development framework and Docker development and deployment,and provides task monitoring and data management functions.