正则表达式在语料库研究中的应用

The Application of Regular Expression in Corpus Research

语料库技术的关键在于通过对大规模真实文本的自动化分析处理,探索自然语言的内在规律。计算机程序编辑中广泛使用的正则表达式技术,因其强大的文本批处理能力,被逐渐应用于语料库开发和复杂检索等相关技术中。本文的研究目的在于厘清正则表达式的起源、概念和构造,并以任务驱动的方法,以几款常用的语料库工具为例,探讨正则表达式在文本清理、语料标注和检索等技术环节中的具体应用,从而进一步推动正则表达式在语料库研究中的普及和应用。

The essence of corpus technology lies in the exploration of the inherent laws of natural language by means of automated processing and analysis of large-scale real texts. Regular expression, a technology widely used in computer program editing, has been gradually applied to the corpus construction, advanced retrieval and other related technologies because of its powerful text processing capability. Driven by specific tasks and based on several corpus tools, this article aims to tease apart the origin, concept and structure of regular expression, explore the application of regular expression in text processing, annotation, retrieval and other aspects of corpus technology, and thus further promote the application of regular expression in corpus research.