统计语言模型综述

A Survey on Statistical Language Models

1引言 统计语言模型产生于基于统计方法的自然语言处理系统的研究中:如语音识别系统、字符识别系统以及机器自动翻译系统等.对于一个语音识别系统,给定语音信号a和语言的句子集合S,则系统需要解决的问题可以表示为:

The Statistical Language Model (SLM) is a distribution to capture the generation rule in natural language. Since the first model was proposed in 1980, the SLM was used in many application such as speech recognition, optic character recognition, machine translation and etc. Recently the information retrieval based-on SLM is becoming a new direction in IR community. In this paper, we introduce the primary theory and current method about the SLM, and point out several promising research direction.