期刊文献+
共找到1篇文章
< 1 >
每页显示 20 50 100
Ontology-Based BERT Model for Automated Information Extraction from Geological Hazard Reports 被引量:1
1
作者 Kai Ma Miao Tian +3 位作者 Yongjian Tan Qinjun Qiu Zhong Xie Rong Huang 《Journal of Earth Science》 SCIE CAS CSCD 2023年第5期1390-1405,共16页
Geological knowledge can provide support for knowledge discovery, knowledge inference and mineralization predictions of geological big data. Entity identification and relationship extraction from geological data descr... Geological knowledge can provide support for knowledge discovery, knowledge inference and mineralization predictions of geological big data. Entity identification and relationship extraction from geological data description text are the key links for constructing knowledge graphs. Given the lack of publicly annotated datasets in the geology domain, this paper illustrates the construction process of geological entity datasets, defines the types of entities and interconceptual relationships by using the geological entity concept system, and completes the construction of the geological corpus. To address the shortcomings of existing language models(such as Word2vec and Glove) that cannot solve polysemous words and have a poor ability to fuse contexts, we propose a geological named entity recognition and relationship extraction model jointly with Bidirectional Encoder Representation from Transformers(BERT) pretrained language model. To effectively represent the text features, we construct a BERT-bidirectional gated recurrent unit network(BiGRU)-conditional random field(CRF)-based architecture to extract the named entities and the BERT-BiGRU-Attention-based architecture to extract the entity relations. The results show that the F1-score of the BERT-BiGRU-CRF named entity recognition model is 0.91 and the F1-score of the BERT-BiGRU-Attention relationship extraction model is 0.84, which are significant performance improvements when compared to classic language models(e.g., word2vec and Embedding from Language Models(ELMo)). 展开更多
关键词 ONTOLOGY BERT model name entity recognition relation extraction knowledge graph
原文传递
上一页 1 下一页 到第
使用帮助 返回顶部