农业知识图谱构建数据集

A Dataset for Constructing Agricultural Knowledge Graph

通过信息技术提高农业生产的效率、优化农业生产中的问题对我国农业发展至关重要。目前,信息技术的发展产生了海量数据,这些数据大多以碎片化、非结构化的形式分布在网络上。尤其在农业领域,使用传统搜索引擎进行信息检索难以高效准确地获取其中有价值的农业信息,往往需要消耗大量的时间和精力从海量无组织的数据中进行二次收集和整理。针对上述问题,本文通过网络爬虫技术挖掘公开的农业网站中的数据,经过自动化或半自动化数据清洗、去噪等过程,将非结构化的数据重新组合成结构化的数据,最终以知识图谱的方式进行存储。所构建的农业知识图谱数据集包括粮食作物、经济作物、水果、蔬菜等11个农业大类、共计8 481个小类的条目数据,每个小类条目对应一种农业生物或药物。具体包括粮食作物461种、经济作物2 208种、水果1 294种、蔬菜257种、食用菌118种、花木1 161种、水产142种、农药113种、农作物病虫害1 605种、兽药519种、中草药603种。根据该数据集构建的农业知识图谱三元组达到90 508条,规模较大、覆盖品类较为广泛,能够为农业知识问答、推荐系统等人机交互友好的智能应用研发提供基础数据支撑;同时,在生成式大模型中融入农业领域知识图谱,有助于在垂直领域上实现更为高效、精准的信息检索和智能决策。

Improving the efficiency of agricultural production and optimizing the problems in agricultural production through information technology is crucial for the development of agriculture in China.At present,the development of information technology has generated massive amounts of data,which are mostly distributed on the Internet in fragmented and unstructured forms.Especially in the domain of agriculture,using traditional search engines for information retrieval is difficult to efficiently and accurately obtain valuable agricultural information,often requiring a lot of time and effort to collect and organize secondary data from massive unorganized data.To address the above issues,this paper utilizes web crawler technology to mine data from publicly available agricultural websites.Through automatic or semi-automatic data cleaning,denoising,and other processes,unstructured data are recombined into structured data,which is ultimately stored in the form of a knowledge graph.The dataset for constructing agricultural knowledge graph includes item data for 11 agricultural categories,such as grain crops,cash crops,fruits,vegetables,etc.Specifically,it includes 461 types of grain crops,2208 types of cash crops,1294 types of fruits,257 types of vegetables,118 types of edible fungi,1161 types of flowers and trees,142 types of aquatic products,113 types of pesticides,1605 types of crop diseases and pests,519 types of veterinary drugs,and 603 types of Chinese herbal medicines,totaling 8481 subcategories.The agricultural knowledge graph constructed based on this dataset has 90508 triplets,which can provide basic data support for the development of human-machine interactive intelligent applications such as agricultural knowledge Q&A and recommendation systems.Meanwhile,integrating agricultural knowledge graph into generative large language models can help achieve more efficient and accurate information retrieval and intelligent decision-making in vertical domains.