网络用语词典的构建及问题分析

The Construction of Internet Slang Dictionary and Its Analysis

随着互联网应用的快速发展,网络用语的使用越来越普遍,网络新词层出不穷。网络文本中大量的网络用语,对基于自然语言处理的情感分析、产品推荐、问答系统等应用带来了一定的挑战,而收集并构建网络用语词典及相关语料则是解决此类问题的突破点。该文以微博语料为出发点,综合多类网络资源,收集并整理了较为全面的网络用语词典及相关语料。同时,对网络用语词典构建中遇到的问题进行了分析和总结,并对其潜在应用进行了初步的探讨。

With the rapid development of the Internet,the internet stangs are becomming common and now shangs are constantly apparing.To deal with this challenge for natural language processing tasks like sentiment analysis,product recommendation,QA,etc.,an internet slang dictionary is necessary.This paper analyzes the problems encountered when collecting and annotating micro-blog texts,together with other internet resources,to build the dictionary and the related corpus.Further,the potential applications of this dictionary and the corpus is discussed.